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The Rural Faaily Developaent (BFD) Project endeavored 
to instruct disadvantaged adults in basic skills through a 
hoae-based, aulti-aedia systea. The report, the last of three, is 
divided into three sections. The first (18 pages) contains five 
essays defining the basic positions taken by the BFD staff and 
discussion of the influences these positions had on the design of the 
project. The second section describes the BFD systea (80 pages) as it 
was iapleaented during the 20-veek field test— a aediated systea 
using television, inforaation bulletins, hoae visits, radio, a 
monthly Alaanac, and toll*free 24-hour telephone service--and 
evaluations (180 pages). An internal evaluation by the BFD staff and 
the University of Wisconsin Psychoaetric laboratory deter ained, 
through a survey instruaent and personal interviews, that the hoae 
visit and aedia foraat were successfully received by the adult 
students* An external evaluation by the Bunan factors Research 
Laboratory reported aized responses to the way in which the aedia 
were used and as to how well the objectives were set. The final 
section (six pages) discusses project inforaation disseaination. 
(AG) 
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PREFACE 



This is the third and final Annual Report of RFD, During 
the three years it has been in existence it has designed, 
field tested, evaluated, and reported on a multi -media 
system for home-based continuing education for adults. Its 
primary target audience were the members of that segment of 
the population who are limited to their competence to 
adequately function in common adult roles as they are cast 
in the milieu of contemporary American society. The factors 
which have tended to limit the competencies of adults derive 
from a host of economic, social and psychological determin- 
ants. They manifest themselves in a variety of ways tending 
to create the general effect of hardship and limited oppor- 
tunity. 

The basic assumption taken by the RFD project was that hard- 
ship and limited opportunities can be ameliorated by infusing 
practical coping and basic educational skill information into 
the individual's life. Tlie way in which this was attempted 
and the extent to which it was successful are related in 
the pages of this report. 

The first section contains a number of essays proffering 
the basic positions taken by members of the RFi) staff and 
discussions of the influences these positions had on the 
design of the project. The essays originally appeared in 
the RFD Newsletter. 
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The second section describes the RFD system as it was im- 
plemented during the twenty-week field test. This is 
followed by a discussion of the bifurcated evaluation. The 
first part was generated internally by the cooperative 
efforts of the staffs of RFD, and the Psychometric Labora- 
tory of the University of Wisconsin. The second is an 
external accreditation by the Human Factors Research Labor- 
atory of Colorado State University. 

Lastly, a resume of the activiti 3 of the project in dis- 
seminating information about its operation is presented. 

RFD is an heuristic in that it is not an idea advanced 
because it is true but rather because by thinki.ig about it 
and working with it, it may enable us to arrive at some- 
thing that is true. Since its inception the RFD staff has 
appealed to the professions to participate in the dialogue 
that has evolved the present work. The task is not finished, 
but it is now up to those who would think about it and work 
with it to bring it closer to fulfillment. 



THE RFD POSTURE 
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HOW 
RFD 
UTILIZES 
CONTEMPORARY 

THEORIES 

OF 
MASS 
COMMUNICATION 



RFD is an adult basic education project which uses three channels 
of communication: television print, and person-to person. There 
are various theories of communication which account for the 
factors that effect these forms of communication And RFD is 
taking advantage of these theories. The following is a review of the 
relevant theories of mass communication that are being utilized 
in the RFD project. 

The "individual difference" theory of mass communication, as 
explained by Melvin De Fleur in Theories of Mass Communication, 
states that the effect of mass communication varies from perst^n 
to person because each person is psychologically unique. However, 
the theory states that if the general psychological make-up of the 
audience can be determined, then the effect of mass comrnunica 
tion can be predicted somewhat. Furthermore, if the people have 
similar characteristics, they wilt have siirjilar ruass communication 
folkways and thoughtways. 

RFD utilises this theory by recogni/ing the special charat.teristics 
of the rural undereducated (e.g.. being afraid to reveal short 
comings, lacking adequate self -image, fearing ronipetition. et( ) 
and by preparing special televised and printed adult basic education 
information that allows for these characteristics, in "CofTtfnuni<.a 
tion Research" published in Current Trends in Social Psychology, 
l^au! La^arfeld noted the potential effectiveness of this approach 
when he said that broad colIe(,tives. aggregates or social rate 

gories such as rural undereducated adults- can rear t 

uniformly to given stimuli. 

With such an understanding of its audience. RF t) intends to change 
both attitude and overt behavior of participating RFD meniber<i 
The goal cf RFD is to provide the undereducated rural adult the 
life-coping skiMs necessary to qet out of the poverty cycle RFD 
makes the assumption that the psychological processes are »'c iated 
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RFD sptciati2ed content materials wilt be ordered by the RFO 
member and tent to hit home after he ha$ either seen sOtnethi iQ 
on the RFD TV show that interests him or after he and his 
visiting teacher have decided on an appropriate subject. Rural 
underedudated adults receive little mail, so, this will be one more 
way to impress the RFD member with the importance of the con- 
tent. In addition, the RFD content materials will provide the 
needed tangible instructional tools that are impossible to present 
via television. These materials will reinforce and expand the infor- 
mation presented on television and by the visiting para professional 
teacher. 

Lazarfeld. Berelson and Gaudet in P§opte*$ Choice recognised the 
importance of interpersonal communication in the overall effect 
of mass communication. So has RFD. Every week a teacher will 
go to the home of the RFD member and \a\k. Whatever the RFD 
member has picked up. either from TV or specialized content 
materials, can be reinforced and amplified by the visiting teacher 
The role of the RFD teacher will be crucial to effecting overt be- 
havior changes. The relationship can be explained with the ABX 
model : "A" would be the para-professional teacher. "8" would be 
the RFD member, and "X" would be the RFD project and content 
materials. 



to overt behavior patterns in social settings. For instance; 
A promotional film for RFD employs this assumption. The film 
presents the dismal side of rural life, mentions the hopelessness 
that many undereducated rural adults feel, and explains how 
RFD can help. The film has yet to be aired; so success has yet 
to be determined. But the film is not unlike commercially 
successful attempts to persuade by appealing to such basic 
psychological processes as anxiety, status, social approval, vanity 
or sexual drives. 

However, as Festinger and others have noted, attempts to influence 
someone else varies according to how attracted to the source the 
other person is. And the typical RFD member is not particularly 
attracted to educational TV. formal educational materials or 
stuffy old school teachers. So RFD will do as much as possible 
to make itself attractive. Unlike typical ETV productions. RFD 
shows will emphasize entertainment. Drarnas. news shows, soap 
operas will be formats for adult basic education materials. With 
such entertainment. RFD will be testing the "incidental learning" 
theory Schramm resents in his Teleyiiion in the LiwsofOur 
Children. 

RFD will not depend on television to effect overt behavior ' 
changes. As Festinger pointed out in his article "Behavior Support 
for Opinion Change" in a 1963 issue of Public Opinion Quuurly, 
fUSt because mass communication changes attitudes does not 
necessarily mean overt behavior can be changed by mass commu- 
nication. But. if RFD's television presentations change just 
attitudes. TV wilt have done its job; because there are two 
other communication methods RFD wilt utilize to effect overt 
behavioral changes. One is specialized content lessons to be 
mailed to the RFD member; and the second is personal visits 
by professional teachers. 



A 




B 


^ 


PARA-PROFESSIONAL 




RFD 


RFD TEACHER 


( 


MEMBER 








As Newcomb suggested in "An Approach to the Study of Comnui- 
nicative Acts": As the teacher (A) communicates with the RFD 
member (B) about the content (X). they become dependent 
"not only because the other's eyes and ears provide an additional 
source of information about X. but also because the other's 
judgement provides a testing ground for social reality." This 
dependence will greatly influence the effect of the overall com- 
munication program of RFD. 

After this brief explanation of RFD. it is possible to diagram the 
communication network and show additional communication 
patterns. See model upper left. 

Notice the new elements in this diagram ; the participating RFD 
member is in communication with non-HFD rural adults, both 
those who have seen the RFD shows or promotions and those who 
have not. Hence. RFD will be effecting a 2-step flow of informa- 
tion and creating an opinion leader. 

A 2-step flow of Information occurs when the RFD member tells 
his friend, who know nothing of the show, about something he has 
learned via RFD. {RFD content is extremely practical stuff, so this 
is sure to happen.} Likewise, when a friend who has seen the 
show but isn't a member asks what's It all about, an opinion 
leader is created. This is extremely beneficial for the adult 
learner : recognition from others will be essential »or him to 
continue in the program. 

There are several other significant theories of mass and inter 
personal communication tnat apply to the RFD project, such as 
Everett Roger's theory of the adoption process, and these theories 
will be utilized by the RFD project. Their application to RFD 
will be explained in future Newsletters. 
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HinuTnii 



FEBRUARY 1970 




GRQWING PAINS 

BORIS FRANK. PROJECT 
DIRECTOR FOR RFD, 
EXPRESSES HIS VIEWS 

AcJull Basit. tdu<;ation as a profession in the United States is 
young, f-ortunately.^in the last several years the federal govern- 
•'u?nt and various state agencies have recognized the need for a 
• oofdmated formal basic education program for our 25 million 
Dutwifial t Uutns. Asa young field with limited professional ex- 
pertise. AHt IS .-xperiencing normal growing pains. We have some 
iiruhlifn*^ It IS time we face up to them before they become in- 
grown .♦ (1 hke to . onsider a few of these problems that we feel 
ttronyly abotit at RFD 



THE AMATEUR LOOK 

Stiv e ABt if a very young field there is little specially produced 
professional content material available to it. Oty the whole. ABE 
materials are adaptations of elementary school texts. Several en- 
lightened commercial companies have recognised the need for 
specially produced content, but the greatest burden falls on the 
luccil tuacher to prepare relevant ABE materials. 

Mv hat IS off to those dedicated teac hers who have been creating 
.it*:* Mii/c'd ''Mterials for their learners. 

f>iit ift s tci« I* It fr«ost ABf^ tea* hers are not equipped to prepare 
i H tt'iisivf* rnatrndis The art work and design are often bad. the 
lyrmg lione on an ultj portable, run off on a sickly mimeo. Good 
mtrntiofis and expei't temhmg capahihties unfortunately do not 
.iiw.iv Mt^vili in pfoiiiM tion of the b<»st niaterials. 

» t>i wftal vf.«s tiow w»; hav<* ratiunali/ed this tnethod of produ(. 
ht»fj asfssrtitiai U) th(» tt<»velopment of "individualiifed" ftiaterials. 
HimIIv It has pivt hfM»n a stopgafi ftieasur^v There's 10 reason in 
ihf? wt)f I'i why v^f» f ati't develop a (.entt.il professionil system for 
uKJivHinfih/alion and personalization of teaching tools 
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fsio one will deny that local leacners and lht?ii ihents must .un 
tinua to piay a key role In the development ana piesknpttun ol 
materials. But in talking to teachers in ABE. 1 have found that 
they are preparing most materials strictly in self defense They 
tnust either prepare units themselves ui go without maiei lals th«v 
feel are relevant and pertinent Though there are a number of 
fine commercial systems available, they do not satisfy many lociil 
needs. 

It's unfortunate to note that most of the materials used at some 
of our largest ABE centers are prepared locally, and those na- 
tionally prepared are used as supplements. This is backwards. 
The nationally produced materials and concepts should be the 
base of operations, and locally prepared materials developed only 
when the national supply doesn't satisfy local needs. 

As long as we force the well intentioned local ABE teacher to 
prepare the majority of materials, the amateur look will rerriain 

With the state of educational technology at such a high level in 
other fields, it behooves us to harness these new techniques for 
ABE. It is time we make available to local teachers materials that 
utilise quality production techniques. Since it does not seem to 
be economically feasible for commercial publishers to take on the 
developmental task. I suggest, because it is essential to the profes- 
sional growth of ABE , that we iitabliih « nitionil emttr for 
ntiteriitt development. 

This national center should carry on research, produce experi- 
mental materials, and work closely with commercial publishers 
as a central coordinating agency. It should include content 
development experts, research specialists, evaluation experts and 
professional communicators including graphic artists, radio and 
television production specialists, audiovisual specialists, and print 
media specialists. Materials developoient must be a team effort 
by all these people. We can no longer condone development of 
materials on a high quality concept level but at tht lowest possible 



iTiust bn integrated 



design and execution level. The design ()rocess 
into the total developmental process. 

Most ABE materials now bein*j used are fiot designed to t omnuj 
nicate. The covers, page layouts, and ilUistrations do not tnoti 
vate. We are educators, but we arealso cotuniunK alois It is 
time that we devote some of our resouri es to communicating 
by utilising proven motivational desiqn tei.hmcjues 

THE LAST MINUTE SYNDROME 

It is a very sad fact that most federally -sponsored proposals sub- 
mitted by educational institutions are developed at the last mm 
ute. t would venture to say that in a majority of cases cdu<.ators 
develop major proposals in a rush, creating them in the two or 
three weeks preceding the submission deadline and mailing them 
at the last second-^the way most Americans send m thei, income 
tax returns just before midnight April 15. Rather than taking 
the many months really necessary for the developmental process, 
proposal writers dash out their documents, hoping thai weight 
rather than substance will prevail. There are still thos«i who thmk 
that the heavier the proposal, the more money you get 

It is absolutely essential that we. as the proposal creators, spend 
more time on prt*planning stages^ especially working on the 
definition of needs of our particular clientele. Proposals sh(;uld 
be very systematically on the basis of the needs we identify 
^art of the responsibility for systematic development of proposals 
lies, of course, with the U. S. Office of F dti< aiion and thf; walu 
ators they bring in co sp*df t the proi«< ts to h<» fnndpfj it is ip to 
them to recogni/e those proposals that h.jvf Imun vfry .iii-f-iliy 
prepared with a sound foundation based on * imwt nnfid-. A% 
soon as the writers realize that the OffiM- of I du/dt 
funding only carefully develop«<i propos.!!;,. ih(! ••l.ip (j.isfi i.r t 
minute proposal will no longer be subiniiteU. 
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THE HANNINQ STAGE . 

Most ABt operational proposals call for the first months of the 
Mfoject yr?ar to be devoted to planning, with innplementation 
dur ing the final months of the first year. The operational phase 
<»xtends into the second year, with temunal evaluation In the last 
two or three months of the project. 

Must project planners devote too little tine to the developmental 
stage. The most successful are those who have devoted the entire 
first year to the creative process. 

At RFD we are using the first year to develop creative materials, 
create a detailed philosophical approach, prepare a viable curricu- 
lutn model and carefully study the needs of our clients. In this 
way we are capable of creating a truly innovative approach to 
rural ABfe. This total concern for the creative process and the 
lack of a need tor devoting most of our time to implementing 
operational procedures in the early stages has enabled- us to come 
up with some very exciting new approaches to the treatment of 
ABE problems that will have. I am sure, a very far reaching effect 
on continuing education in the coming years. 

I am pleased to say the Office of Education has fully supported 
this planning tinte concept. I recommend very strongly, there- 
fore, that at! special demons .ration projects that hope to be 
innovative ineiude enough time for the creative process to deveiop 
in a normal way. it is only by trial and error in most cases that 
we c dn disc over if the creative process is working. A great Jeal of 
tiiT^e is nended just to sit and think about the problems and to 
have brainstorming sessions that will enable us to open up new 
vistas and approaches to future developments in our field. 

THE BUDGET 

Most ABE special projects have severe budgetary shortcomings. 
In the past. t>udgets were usually too low. Recently the Office of 
Education has rrioved toward funding fewer projects, but funding 
those they do support on a much higher level. This is an ex- 
trpfT'fMy healthy devftlopment that will insure more professionalism 
\n ABt: . 1 1 IS 'nuf h more important to fund a few projects ex- 
trerniy well -creative and innovative projects that will contribute 
Significantly to the national picture- than it is to spread available 
funds so thin that all projects suffer. 

Salari^?s have been too low in most cases. I believe we must start 
iticreasing the budgetary allotments for professional ABE staff. 
If we are gomg to attract the best talent for development and exe- 
i.uxion of Our projects, it is essential that we be competitive with 
other fields for talent, or better yet. we should orfer higher 
salaries than other fields m order to attract the very best possible 
talent 

Proiects should inc lude substantial funds for communications 
cfesign If we need the services or an artist, adequate funds should 
be tn( luded m the budget to have a good one . . , not minimum 
wages for a mirwmum art»st We should not ask the prc*3SSional 
educator to he a professional artist. A good commercial artist 
these days receives anywhere from $10,000 to $20,000 annually. 
Let s be prepared to pay that price to insure the high quality 
we war.t tr> our profession. Let us not forget that we are in the 
<.uFnrTuini(.ations business We agree that one of our biggest prob- 
fertis IS rrjotivating and retaining students. We must be willing to 
spetuJ mon«y on first-rate corumunicators to assist the professional 
H(iu(.ators in gettirtg the message across. 

THE ELEMENTARY SCHOOL SYNDROME 



PUfDOlt Of iduciting the child is to prepare htm for adult roJes 
But the adult Is already there and his needs are vastly ditteient 

When an eleven-year-old child is in the 6th grade his life style 
experiences all revolve around a fairly uniform level. His cortipu 
tational and communication skills are all roughly at that level 
This is not true of the adult. Life-style experiences of the adult, 
first of ait, areextrenr>ely diverse; and computational skills may 
be at an extremely high tevei-in some cases, at high school or 
above-awhile communication skills rTiay be on the first or second 
grade functional level. And yet we have been relying on tra- 
ditional elementary school materials in ABE classes. 

At the recent Galaxy Educational Confereiu e in Washington I 
visited all the commercial display booths. At each one I dsked 
for materials specifically prepared for Adult Basn: Eduuition 
Several of the largest publishers indicated that they hatfft't pie 
pared anything special for ABE but that materials prodi.<:ed for 
children were "usable." 

We cannot rely on elemtntary school matiriats any longer at a 
stopgap measure. We must not make do with just "usabU?" 
materials. It is time that we discard traditional efementcity S( hool 
grade levels and develop our own system of content cont^ept 
development. Traditionally we measure all educational success by 
vertical movement, If a student moves from the 4th to the 
5th grade performance level he is a success. If he doesn't pass, 
he is a failure. A student who does not move from the 10th to 
the 11th grade is a high school dropout. He is a failure It is a 
sad fact that most ABE programs are still based on this vertical 
movement theory. We measure success on the basis of i lovement 
from one artificial grade level to another --a grade level cruerion 
designed for elementary school children. Very few ot our pro 
grams allow for horisontel development of our client in addition 
to vertical skill improvement. Properly, one ABL goal is to en 
courage vertical basic skill improvement. However, there are 
many ABE students who, for one reason or another, rriove ver 
tically very slowly and who have a great need for horizontal 
development of life-style coping skills. The RF D project has 
developed a new system and technique for serving these adults- 
a system that allows unlimited horizontal skill development. The 
sooner we divorce ourselves from traditional eleinentdry youth 
centered criteria for educational in^provement, the better off we 
will be. Let's develop our own system of ABE criteria that are 
directly related to the needs of our special clientele. 

These are some problem areas we have recognized and can do 
something about now. The sooner we create a professional fran»e 
work for our field, the sooner we develop a viable ABE discipline, 
the sooner we shed the "stepchild" robes, the sooner we will be 
able to serve our clientele more efficiently and effectively. 



Most ABE materials are prepared on elementary school equiva- 
lency levels. We talk about textbooks being on a "third grade 
level" or on a "fifth grade level." This is fine for children. The 
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RFD's Stevs Udvari 

"THE NEED FOR NEW CURRICULUM 
DESIGNS IS NOW I" 



fhinfj IS a pressing need for ABE spet.ialists 
to w onsirtof th«» philosophies of ABE-and 
thoy mjficf to do it tiow 

The a«Jult learner ru?»^rls to learn rtiore than 
fitst how to be ffinployahle- he needs to 
if'rtf n how \n enioy hff». 

ABI s|wn i.ilists h.ivp (werloc^kcnl the role 
.It full erJuc.ifion plays in sot iiil t hange 

Ihos<*afe v)t»'fM)f thncon- lusions ilrawn by 
fU D Asso« ifjtc> PtojPi t Diret lor Stpve Udvari 
rn (} pap^Y M>i j'f.ily prost^nted to the National 
Working (Innferpfv p DP Adult Curriculuni 
MHt»*rialsatwJ RiMritf?({ Media at Cherry Hill. 
N#»w .Ji?f vfy f fw toHowmg is a condensed 
vprsion of thtit papiT 

ni»porfs i)f our .1 Ivrim es in ter hnology 
stress on«» rhiMi ^ man is being made obso- 
Itlt. f h#»j* i«. .1 qrowifig feiMing of futility 
affiunq jrfniis n) training and retraining oro- 
girfpjs. It 1^ thfir n^hs that witt be obsolete 
in thwnexi stagf»of lp«hnologh a! advance- 
nipni Mar» is * Hfigmg desperately to one in- 
t.inyfhie thrpad of his Hxisten* e the dignity 
<if men. Th(> < nittirally and edu^ ationally 
ttnu|n«! arp se^'k mq to improve the quality of 
th^ir tivei. f fiey <\to seek ing strategies to 
I fipf? wfth Idp pv'Pnts Reading, writing and 
I otnptittng are arjiong these strategies-as are 
«9*tting<) ;f)h. nidkiny a budget, and knowing 
thi} man to : ali when you have f^o other 
\)\m e to Nirrv 

fhe new hasn edti< ation ( urriculum for 
♦KhiHs should grow out of the needs and 
p>i|ii^*ii>fv <»s t f the learner and (.on tribute to 



his self-development and to the improvenieni 
of the quality of his life. The scope of sui:h a 
curriculum, to be effective, must go beyond 
the literacy skills level and strengthen the 
learner's «:ompetencies as a person, a parent, 
a worker, and a riti/en. The challenge of 
Horace Mann remains: "Education, if it is to 
mean anything, must teach us how to live." 

Curriculum design is not the a< t of simply 
adopting or adapting existing child- oriented 
materials to adult applications. Curriculum 
design is a process of determining a system 
of relationships between the learner, the 
teacher, and the total supporting resources 
of institutions. 

The great weakness of present ABE pro- 
grams is that they are implemented without 
sufficient lead time to develop a viable cur* 
ricutum. One result of this immediate im- 
plementation is that national ABE has never 
been organized around a specific philosophy 
or statement of goals. At present each pro- 
gram and organization seemingly pursues 
divergent goals, not the least of which is self 
perpetuation through continued funding. 

ABE professior als have two challenges 
before them: 1) they must design new 
models for ABE and develop supporting 
<:urricuium materials, and 2) they must 
promote and enlist publisher interest. 
' The need for such effort is now! Where 
do we start? We start with a definition, a 
design model, and a criteria of needs. 

First, we need a working definition of 
ABE. I present, as a point of departure for 
further thinking, my definition: 



Atfcilt Bills Cducitlon it an Inttitutlon 
program in the continuing stiMm of lif Hor 
eduettion designed to provide eKptrienees 

to imprave the quality of life of adults vvh 
•re functioning at a level of performance 
that does not permit their sicillf ul use of 
•vailaMe alternatives and their total invotvr 
ment in today's complex society* 

Since adult edut aiitm < (^ntnluitesdiiPi t 
and imniediausly to in* ie«isitiq ilie to«npp 
tence of adults who are afttn ted hy i ttni « c 
if)fUieni e) iTiany asp»«< ts of soi i«il j h,!iu|p. «» 
l oncept model < m he designee} ihul it»i.rlps 
to all majOf life rotes <ind whi< h < cjn si»t v<» f 
develop content » enters for listing evpei i- 
ences on a l)road range of htimar) inti*tpsts 
and ruteds. 

Goals for ABt arc derive;! from thi» net 
of adult individuals, Thes<» are a wide rant 
of felt, real and postpone<l needs. how(?ver 
nearly all can be assigned to one of tfu; fol 
lowing four oitegories 1) need to Know, 
identify; 2) need to relate, he heard O nt 
to work, l)e productive, A) need to « c;. 
tribute, deter mine one's own destiny 

Using these needs, we i an presi i ibf! <i m 
of goals. They are 1) the goal of wlf 
realization. 2) the goal of human rolal»on 
ships. 3) the goal of eronomic effi* ienry. 
and 4) the goal of civii r«sr)onsibility. 1 \ 
goals define the life roles of man Thesit 
roles are man as a person, a parent, a work 
and a citizen. These roles serve lo esiablu 
the basic corii epts involved in ABE. The 
concepts are identifi^ ation. itrraction. pn 
diiction and participation. 

_ Knowledge is applied to \ho task of at 
quiring skills, ways of doinq or tUMliiu} vi/t 
things. As a result of our np(?d to know. \ 
dt?velop literacy or tofnmunii ation skills 
We use these skills to tialher intormatmn 
about ourselves and others. In turn, they 
help us develop social skills as a resjionsi* 
Our need to relate, th(» act oi getting alt)fv 
with others. As the result of our human 
relationship interactions, we nee(f to do f- 
others-we need to work, to « reatc. to Uh 
productive. To be pioduciively ongacjHd • 
must acquire voc ational skills. Our voi a 
tional skills are used to rt^kc^ < onti ilmtiOi 
to the ( Omrnunity. As cominunily riersOi 
we employ coping skills to par in ifiaie in 
civic responsibilities. Ultimately* these 
coping sidlls are used as strategies for pc! 
cat and social change. 

These ABE concepts must be ti.irisl.iti 
into an edutational delivery sysiem «iioin 
which a viable curriculum t an he tlpvt'i«)|: 
RED will ertiploy an integrated < urri* uln. 
approach; the curricijlum skills will n(»l I* 
taught separately as in traditional liti»ra( ' 
program. Most currir ula for adults an* d, 
signed in traditional textbook fashion, w 
separate t^xts for reading, writing. 'OM'p* 
ing. and social skill improvement f^l 1 1 • 
integrate all of these variables in sinqieuf 
presentations. Relevant sex lal • ooinq sn 
egies will be deternuned on a priority s« . 
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ifi «tV9 uu\t9rt tanr o and siffjultaneouity 
^tttittc|i«iff<fl With listonmd. speaking, reading. 
'HmHUui writing and roffimiting skill develop 

MNftlt 

The \mU promise of the Integrated Cur- 
rti tilitir) Design is that adults can be taught 
to rear}, write, and compute through a systenn 
ol c oping skills »hat represent their nnost 
pressing needs within their immediate life 
frame. These strategies are designed in the 
form of problem solving relationships for 
strengthening judgjtients in exercising the 
adult role as a person, a parent, a worker/ 
(X)nsumer and a c iti/en. 

Almost invariably the first objective of 
most ABE programs is to help the adult 
master the basif. education skills. There are 
few adults who want to master anything, let 
al0f)e basic education skills. RFD is interest- 
ed in upgrading learner skills in the basic 
siibject areas, but. we are also interested in 
enabling adults to learn to employ strategies 
n^ed on improvmg the quality of life 
while learning other practical skills. 

Mott ABE specialittt have unwittingly 
WiHooktdL or wont, minimiattd the contri- 
buliofi of idult education to deal with icttial 
^ Traditionally tiiere halt be«) over- 

Mipliaiif on method of education and degree 
. of liiriiii involvement instead of focusing 
on social toiuef and problems. 

The ftFD proiect addresses itself to one 
>t the most perplexing variables confronting 
^itl ABE programs- the problem of motiva- 
tion. After working hard all day or being 
frustrated by continued unemployment, it is 
hard for an adult to drag himself out of the 
house, drive miles to some classroom that 
reminds him of early failures, and then be 
bright and receptive to his "educational op- 
portunity." Adults want to participate in 
programs at their own timetable, when their 
desire is at a peak, and when what is being 
taught interests thein. Adults want to come 
when they can. leave when they want to. or 
when their needs have been met. and return 
anytifT>e they feel the urge. Unfortunately, 
"tany adults become forced dropouts simply 
because they missed three classes in a row. 
or failed to move sequentially from one 
grade level to another. To meet these kinds 
of needs, program designs must consider and 
incorporate the variables of flexibility, avail- 
ability, and applicability of the curriculum 
delivery system. 

RFD will meet these challenges because 
it is not the traditional classroom and in- 
front-of-the-chalk board setting. RFD will 
be in the homes. The project is designed as a 
three-pronged thrust, utilising television, 
individualized home-study techniques and 
personalized contacts in the home to reach 
its participants. 
^Il^ We have learned in order to reach these 
^Bopie with messages, we must use those 
things through which they are now receiving 
mes.iages. Television has been selected as the 
^Hiiiiary vehicle for conveying messages to 
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and motivating potential rural learners, be* 
cause we know that nearly 98% of ail rural 
homes have at least one TV set. 

As you can gather, what will be offered by 
RFD wilt be practical. The content units 
will expand learning situations to which the 
adult's background of e^nerlence can readily 
be related. Thorndike in his Learning 
Theories of connectivism points out that 
adults have already made many permanent 
stimulus-response bonds which they use- 
some deter rather than further learning. One 
of the purposes of the home-visitation agent 
is to detect these bonds and relay the infor- 
mation to the development team for creating 
new learning situations in order that the 
adult may recognize these errors and learn 
new relationships. In short, the purpose of 
RFD is not to destroy the environment that 
the participants are familiar with, but to 
capitalize nn those aspects of the environ- 
ment that the adult finds somewhat favor- 
able and relevant with which to cope. I 
hasten to point out that the idea of coping is 
not just getting along, rather it is a dynamic 
expansion of the term to mean to deal with 
effectively. 

RFD has been designed around four major 
"Conient Centers." Each Content Center 
contains integrally related information about 
live experiences. These experiences are based 
on the concept development scheme of being 
and becoming, a relationship of moving in- 
ward then outward. The Content Centers 
are: Me. Me and Others. Me and My Money, 
and Me and My Community. 

The ol4ictivc$ for the program arc de- 
rived from an atmsmtnt of adult priorities 
of wants, interests and needs and intcgivtcd 
with the goals of education. Each content 
unit is designed in reference to communi- 
cation and computation skill development. 
Furthermore, each lesson is designed on 
two levels of performance to meet individual 
needs and sequencing for developmental 
growth. Individual differences are considered 
in terms of performance, ability, motivation, 
rate of learning and self-pacing, and so forth. 
A personjlized prescription is provided for 
each learner, allowing all learners to partici- 
pate under full flexibility of personal limita- 
tions. 

Surveys of people with the same life style - 
as potential RFD clients were used to deter- 
mine the priority of adult wants, interests 
and needs. 

Instead of a textbook or workbook, the 
adult learner will receive four empty binders 
with an appropriate index of modular units 
and divider tabs ready to be filled with spe- 
cial instructional units that will be indi- 
vidually prescribed for the RFD member. 
More than 100 different instructional units 
will be prepared to go in these binders. Each 
major topic to be treated by RFD will be 
prepared on two different ability levels; this 
way, each RFD member, with the assistance 
of his home- teacher aid. will select the ap- 
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propriate instructional unit that wilt meet 
his exact requirements. The adult inserts 
the unit in his Content Center loose leaf 
binder, thus beginning his own eru yclopett' 
of strategies for coping with life events * 

Aside from the information and new cor 
ceptsof how to deal with problems, the 
RFD member will \)e guided through a 
delit)erate developmental process of acquir 
ing reading, writing, and computing skills. 
In addition to having all lessons designed o 
two ability levels, integrated into each lessc 
are developmental concepts that perrttit 
learners to grow in progressive achievemen 

The final facet of the RFD curriculum 
design is that every member will be al)le to 
participate in and benefit from the total 
progra?T«. For example, if an individual 
enters on one level and dues not progress 
developmentally beyond that level, he doe 
not have to drop out of the prograni He 
will be permitted and encouragal to con- 
tinue and benefit from the full range of thi 
content materials, since alt subsequent ma- 
terials can be offered him on the same levc 
of performance in which he finds suc.ress. 
On the other hand, if an individual pf o- 
gresses consecutively, he will receive subse- 
quent units on progressively more difficult 
levels. 

Advancement in our public educational 
system is now based on vertical movement 
when you have mastered the second grade 
materials you advance to the third, then tr 
fourth, and fifth. We do not provide for 
those who cannot go beyond o given grade 
level; as far as most st hools are cont erned. 
his education is over. The RFD Content 
Center system provides for unlimited hori 
zontal educational advancement- an RFD 
member can continue to learn, in a variety 
of fields, indefinitely, broadening his lite 
coping skills, at a given success level. Natu 
rally, we hope he will advance vertii ally 
and improve basic skills. However. RFD h 
provided for those millions of Americans 
who cannot do this. 

ABE must abandon the idea of moving 
adults throui^ mcaningjlats gradc-by-gradc 
progression and develop totally new mode 
for adult learning. 
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RFD'S 

HELENEAQUA: 

''W% timt to took at ABE curricula from a 
now point of view/' 

In this decade of national prosperity, 
when our standard of living is increasing, a 
substantial number of adults are unable to 
function adequately because of a lack of 
basic educational skills. These individuals 
are both socially and mentally handicapped. 
They are found not only in certain areas of 
our country, but in every one*of our fifty 
states. 

. According to the U. S. Office of Educa- 
tion there are more than twenty-four 
million Americans who have had less than 
eight years of formal schooling. Of these, 
sixteen million are considered functional 
illiterates, and eleven of the sixteen million 
are living in extrenne poverty. Unemploy- 
ment, low wages, sub-standard housing, 
high rates of aime. and broken homes are 
only a few of the characteristics which the 
poor share in common. "From the lettuce 
fields of California to the concrete acres of 
Harlem, low income white. Indian. Negro, 
and Spanish speaking Americans share 
poverty's harvest. 

Scienc e and automation are changing 
the njininuim educational requirements in 
dll as^iects of the world of work. Conse- 
quently, more and more adults in our so- 
t iety are being riassif ieci as uneducated or 
i»nder edu<:ated. At one time these same 
people i ould have found jobs as unskilled 
Is^borers. but with the rapid advance of 
t«t hnology fnar>y of them have been put 
(Hit of work. If they do find employment 
it IS at a wage level that offers them not 
much more than fTiere subsistence. 

The rurrent answer to this problem 
seems to t)e to put more and more people 
into adult basic education classes. How- 
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ever, it is wishful thinking to believe that 
the currer)t trend of more and more adult 
basic education classes will in any way 
solve the more far reaching and difficult 
problem of the social task which is raised 
by the kind of learner himself. It should 
be recognized that our educational problem 
is a matter of a cultural problem as well as 
an economic one. Often the student of 
adult education classes is a migrant who 
has been drawn into the city from the 
country in hope of a better life. Due to 
some extent to his rural origin he is un* 
ac customed to the city standard of living. 
To add to this problem he is Uiiterate. semi- 
illiterate. non-Hngllsh speaking, or of a 
racial minority. He is psychologically. 
Culturally and financially susceptible to 
illness, crime and exploitation. 

Today's emphasis on the "War On 
Poverty" has brought the concept of edu- 
cation as the "cure all.** the panacea to 
cure all ills. However, education is not the 
only reason the poor are poor. Instead 
it is both the cause and the effect of 
poverty. When lack of education is looked 
upon as a consequence of poverty then we 
can better understand why some of the 
problems exist and why some of the tra- 
ditional curricula are not realistic. 

The problem emerges out of the neces- 
sity for the development of a flexible and 
workable curriculum that will fit the needs 
of a particular type of student enrolled in 
adult basic education classes. 

Today we see growing areas of adult 
education challenging traditional methods 
and programs and working to meet the 
needs of individual areas in our country. 
An increase of local diversity has begun, 
and many communities are working toward 
more diversified programs. It is beco.ing 
more and more apparent that extension of 
day programs is not enough. However a 
review of adult education in the United 
States shows that the curriculum being used 
in most programs is still far behind the 
needs in most areas. Furthermore, in spite 
of the fact that every state in the Union 
has compulsory education and attendance 
laws, the fact remains that a significant 
number of people are under-educated or 
uneducated. 

The U. S. Office of Education is open- 
ing nnany doors for new phases in adult 
education. Programs under Title 11-8 and 
Title HI of the Department of Health. 
Education and Welfare are being funded alt 
over our country. It is imperative that all 
personnel involved in these programs be* 
come aware that these projects are intended 
for much more than just the teaching of 
basic skills. Their prin^ary purpose is and 
must be the development of those educa* 
tionat and social skills which allow the adult 
to meet the needs and demands of modern 
society. 

The primary pui pose and goals of the 
act are as follows: 
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... to Initiate programs of Instruction for 
indivMuali who have attained the age of 18. 
and whofs inability to read and vwrltt tha 
English languaae constitutes a substantial 
impairnMKit to gtt or retain employment 
commaniuratii with their ability to help 
tllminatt such Inabiiitv and raise the level 
of aducation of such indivkluali with a 
viaw to making them lass likalv to baeoma 
dapandant on others. Improving their ability 
to be benefited from occupational training 
othanAfiia Increasing their opportunities for 
mora and productive and profitable employ 
mant. and making them better able to meet 
thair adult reiponsibimies. 

Unless we take a more realistic view of 
some of these facts, the goals of this act 
cannot be reached. We must begin to show 
a marked change from the traditional edu- 
cational patterns of the past. The kinds of 
students are new. the problems are new. 
and therefore the curriculum and the struc^ 
ture around which the programs and cur- 
ricula are built must be new. They must be 
looked on with a new concept and a new 
point of view If we are to accomplish our 
purpose. Mary Wallace aptly put it when 
she said, "They cannot fail today and 
succeed tomorrow, for if they fail today, 
they will not be back tomorrow." 

It is wishful thinking to believe that the 
current trend of more adult classes will in 
any way solve the far more difficult social 
task which is raised by the adult learner 
himself, it should be recognized that our 
educational problem is cultural as welt as 
economic. 

A recent study of adult education by 
the Opinion Research Center at the Uni- 
versity of Chicago. 1963. shows that al- 
though there is an increase of adult classes 
and adult participation in these classes 
throughout the country, the average stu- 
dent attending classes has at least a high 
school education or better. Furthermore, 
the largest group, and the one with the 
greatest need for more education, the 
under-educated, the untrained, and the un- 
employed is not touched by adult educa- 
tion. ^ 

Elementary education for illiterates or 
those who must compensate for education 
missed in childhood or youth is needed in 
nearly every adult program. Every time a 
census is taken we find that a substantial 
number of adults. 25%. has not graduated 
from an elementary school. Moreover, 
some 10% have never finished six years of 
schooling, often considered the level of 
functional illiteracy. In some states the 
pera^ntage is much higher than the na 
tionai figure. In spite of all these facts 
programs continue to be geared for the 
adult who already has a great deal of 
schooling. 

Teaching the adult illiterate and the 
educationally disadvantaged normally ac 
cepted subjects frcm traditional curricula, 
teaching principles, and school practices 
will not succeed. The essence of the prob- 
lem is not primarily one of cultural dis- 
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ability. In reality he must learn about an 
entirely different culture at the same time 
that he is learning the basic sicills. f n 
actuality the two problems are one. 
"Herein ties the problem and the one 
that can be - and must be — overcome." 
Our adult illiterates must have specially 
trained teachers, and specially prepared 
materials if our adult programs are going 
to succeed. 

Jules Pagano. former Director of Adult 
Education Programs. Washington. D. C. in 
a newsletter of November 1966 states the 
following: "We should take a long hard 
took at the < ontent and the goats of basic 
education in this scientific age. To assist 
|)eopte to become futly functional mem- 
ben of the computerized, jet age. we should 
concentrate on consumer education, house- 
hold science, and civic responsibility as 
well as the three R's." 

Although the goals of any good educa- 
ttonal program should be to help students 
achieve proficiency in the basic skills and 
thereby help the student help himself to 
better contribute to the society in which 
he lives, the program must also consider 
alternatives if the student's goals do not 
coincide with the goals of the program. A 
sound program must start where the stu- 
dent is now. and help him to achieve his 
necessary and desired goals. "And perhaps, 
the words his qcmIs - the student's goals - 
are the key words in planning and carrying 
out an effective Aduit Basic Education 
program. 

Lacking the skills of reading and wri^ng 
are not the only skills lacked by the under- 
.educated adult. Studies show that this 
adult is often inadequate in other areas as 
well. He is more often than net unable to 
take care of himself even in reg^Td to the 
most basic rules of health, nutrition, and 
safety. Lacking educational skills and 
suffering from serious social deficiencies, 
it is impossible for him to function as a 
happy and contributing member of so- 
ciety. Teaching him these skills alone will 
not erase poverty nor able him to function 
more adequately, even though he so sorely 
needs them. 

To reduce the problem to mere educa- 
tion is to simplify it and thereby eliminate 
the chance of rectifying it. The course of 
education must be carefully planned, and 
the success or failure of the education of 
the adult is dependent upon, to a great 
degree, the skill and knowledge of the cur- 
riculum director. 

f 0 understand the goats of the student 
and to thereby better understand what is 
necessary for a successful curriculum the 
basic characteristics of the student should 
be taken into consideration. In other 
words, we must ask ourselves. Who is the 
learner most likely to enroll in basic adult j 
classes? The goals of the student usually 
indicate his prime reason for enrolling in 
an adult basic education program. He may | 
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be seeking employmeni or advancement in 
employment; he may need to communicate 
I more effectively, or he may be a referral 
I from another social agency. 

A careful and extensive study should be 
made of the community, the neighborhood 
and the people to be served. The job mar- 
ket should also be carefully explored'. This 
becomes a two*fold task because the goals 
of the students and realistic world in which 
he lives must be matched. In other words, 
the curriculum must look realistically at 
student opportunities after basic training. 
Will he be equipped to get a better job. 
j further his education, go on to more spe- 
j ciali^ed vocational training or. because of 
an unrealistic approach, will the future be 
another dead end? 

Each community should be carefully 
I studied and compared with other commu- 
nities. Other programs should be examined 
and evaluated. The danger here lies in the 
mere duplication of another program. Imi- 
I tation can mean total folly. Each commu- 
I nity should and must develop its own core 
program. However, communities with like 
problems, like population, like work mar- 
kets should be studied and compared. 
Communities that share much in common 
often come up with somewhat the same 
core curriculum. The major point in ques- 
tion here is that adult education cannot 
have a fixed curriculum, but rather it must 
have a flexible curriculum based on the 
specific needs of the student and the com- 
munity. Although upon observation adult 
programs may seem to share much in com- 
mon and are more alike than diffet^nt 
throughout the country, it is sometimes 
just that something different that will deter- 
mine the success or failure of that particu- 
lar program. Sameness on the surface is 
inevitable, and if two programs are exactly 
alike then they should be serving exactly 
the same kinds of people and exactly the 
same kind of community. The common 
core is that which makes up the general 
characteristics of many programs, but it is 
that inner core that makes up that impor- 
tant difference. 

Trying to meet the needs of the students 
in adult programs is a difficult task facing 
administrators today. These adults are 
diversified in training, experience, age. and 
motivational factors that bring them to 
class. How does the school face the prob- 
lem of attt acting ail age groups, at all levels 
of experience, and how does the school 
keep the students after they have en- 
rolled? The answer is not clear cut nor is it 
an easy one. and it seems that one of the 
answers is that adult education will be ac- 
complished via the route of situations* not 
areas or subjects in the curriculum. Each 
adult learner '.an individual with specific 
situations that he finds himself in with re- 
gards to his work, his pleasure and his 
family. There are nrwny other situations 
which call for various adjustments. This is 



where adult education begins. "Subject 
matter is brought into the situation, is put 
to work when needed." 

Since 1960 there has been a great deal 
of recognition of the fact that most adult 
education classes are serving those who 
need education the least. This has brought 
about the severe and critical examination 
of the objectives of the public school edu-' 
cation. With it has also come more atten* 
tion to the financial share of adult classes 
and the need of their being subsidized by 
alt levels of government. Of even more vital 
importance has come a new concept and a 
new focus on the idea that the attainment 
and recognition of the adult to be educated 
should and must be the key factor in main- 
taining the health of the nation. 

Although education on the adult level 
as an integral part of our educational sys- 
tem is comparatively new. educators with 
foresight have long since recognized its im- 
portance if our nation is to benefit from all 
its resources. To have merely given recog^ 
nition to aduit education as a member of 
the education family to date is not enough. 
Nor will it ever truly be a member if adult 
education is to mean merely the extension 
of elementary and secondary education. 
The education of the adult is more than 
just the examination or extension of what 
already exists. It is an entity in itself and 
calls for a different course content, dif- 
ferent materials, different methods, dif 
ferent counseling, different facilities, and. 
most important, different teachers. Per- 
haps the key word here is "different." for 
to have the adult merely repeat those 
courses that have been offered at an ele* 
mentary or secondary te/el is to ask for 
disaster. Each and every factor of the pro- 
gram must be carefully chosen to meet the 
needs of the adult learner. Teachers must 
do more than just teach. They must com- 
plet^y understand, respect, and. above all. 
empathize with the adult learner, or they 
wilt not be able to do their job. 

The basic tools or reading, vyriting and 
arithmetic can open many doors - doors 
not Only to vocational and occupatioruil 
training but also to a larger life, philosophi- 
cally and psychologically speaking. The 
illiterate or functional illiterate lives in a 
world where many of life's doors are 
closed to him. With the acceleration of 
technology, with a growing complexity in 
every phase of today's living, the tragedy 
of not being educated is accentuated, and 
the financial burden to the whole nation 
increases. Basic education has become a 
must for millions of Americans, and spe 
ciallv prepared programs to meet these 
needs have also become a must if we are 
to serve our nation for the common good 
of ail. Educational programs will serve 
the nation well when we have schools that 
face the question alt men have experienced 
and when all curricula are curricula based 
on life's experiences. 
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A STATEMENT OF PHILOSOPHY 
by Stiphin Uchrari 

The major premise of the RFD Statement of Philosophy h the idea that edui .ition is a 
life* long process from the cradle to the grave and Adult Basic tducation is but orie link, 
serving not as an end in itself, but rather a continuing process for ai quiring expi»i u»iu rs 
and skills in coping with the practical events of living. 

The need for Adult Basic Education has never been more acute than m Uus pu'seut agv 
of knowitdgtr txploiion, and tachniul rwolution. As a result more people are hving 
longer, stretching both productive and leisure years. Employment requireiMonts dml ukilN 
are higher. Life rhythms have changed, requiring skillful use of available altw native's and 
emphasising that each individual must have the power to control his own destiny in a 
world that encroaches on the dignity of man and moves him toward obsole» en< t». Leai t\ 
ing. then, is the key. Education must provide for the learner a system of strafegius that hv. 
can apply to alternatives for making judgments and causing behavioral ^ihanges to suit his 
individual purposes. 

Rural Family Development is a program of information and ai.tion that believes in the 
basic integrity of all men and their usefulness to themselves and others Therefor «. we be 
lieve that all men. regardless of limitation, have a basic right to know and devolou lo the 
fullest of their capacities. 

This development process of pen.eiving. feeling, behaving and betoming relati's to ihi» 
four basic needs of rural undei'educated adults, they are Need to know. Neeil to relate. 
Need to work. Need to contribute 

We. therefore, do not-presume to fulfill these needs by providing answers, rather we 
irjtend to present information in terms of alternatives for making judgments and allowing 
the learner to translate them into action strategies. Concrete and practical experiences 
will be stressed as opposed to abstract information and meaningless drill or repetition We 
do not intend to remove the learner from his cultural milieu or takeaway what has mean 
ing for him. rather we wish to supplement it and share the richness of the t.ultur(?r By 
recognizing the learner's special and unique knowledges and skills, we fully uaend to 
build upon his self-esteem. We also recogni/e the great harm in raising the adult's iiivel of 
aspiration without providing realistic alternatives for their fruition Strategies will tie t>f 
fered to guide the learner to be more productive with available resources F mally. there 
will be no hidden effort to change the basic belief:? of the learner for politi(.al or any other 
divisive ends, rather the concept of change will be employed as a process for self 
realization. Hopefully self-reali/ation will lead to a sense of community resj)onsibility 
and participation. 

We subscribe to Jean Jacques Rousseau's principle of "taking the learner where he is 
and leading him as far as he can go." To operationalize this principle we would amend if 
to read "as far as he wants to go." Our aim is not to plot the 'lourse to follow, lather m 
provide road maps on how to get there. The choice of the route and the pa. e ht* wishtjs 
to go must be the prerogative of the learner This may mean ai ceptmg entry <n «inv ievt>l 
of perforn»ance or interest. Furthermore, the learner must be able lo use iht? pfoijr«ini to 
satisfy hts specific needs and not any prescribed pedagogical system that must itie«?t iuu 
gram needs to survive Lapses in program participation or entry and early ter nunations 
and reentry must be accepted as usual patterns of behavior, for the adult learner fiasdit 
ferent needs to satisfy (jt^ferent views of relevance and different realities to wbn h he 
i lings 

Our program is not a literacy program per se. although one of our anris is to lielp the 
adult improve communication and computation skills We believe that the ustj and apph 
cation oJ information is only effective if it conforms with the adult learner's hi-hpfs and 
concept of reality For the most part, adults forget or dismiss fads and « om i-pi-, that nm 
counter to their beliefs, regardless of the soundness of sin h far ts and ' (jtu <»pi-. -.^i. hfih j 
that adults want to deal with problem situations of life and that readiufj dud f iqiinnM 
only two of those problems. Therefore what helps the learner also help-, the l«-.irniri(| 
communication and computation skills are developed and appliefi in hfc i (ipifi<| .iCMftore. 

Although our program intends to serve a mass rural population wtth .m ifi'ir/i'iM.ili/< 'j 
approach, the teacher {home-visitor) is strll the best facilitator of learmnq We l^ lic-^i; Uutt 
the teacher should be a warm human being whose chief purpose i!» to 'naintaifi i helpn.q 
relationship with the adult learner. Personalization is vital to a honif: st-idy opMf .ukmi .tnd 
the emphasis of this relationship is on the learner rather than the < ontent to f»e learned 
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Similar conetpti in adult tdueatien? 



ISRFD 
UNIQUE? 



Proiect Director Boris Frunk 

ANSWER, from Proiect Director Boris 
Frank; 

Many of the elements of RFD have 
existed in ABE programs for years . . . home 
visitors are used in other areas; television 
has been used occasionally; some of the 
printed materials used by RFO can be 
found in other projects. 

The uniqueriess of RFO is in the way in 
which these and many new elements are 
used. These interrelated elements are com- 
bined into a total systems approach to the 
presentation of ABE materials. This is the 
first time that alt of these elements and 
methods of presentation and motivation 
have been combined in a unified, systematic 
way to reach rural adults. RFO demon* 
strates a unique and innovative (/e//V«r/ 
system. 

There are certain elements of RFO that 
are unique and innovative in themselves . . . 
elements that have been tried at RFO for 
the first time. They include the use of 
name stars in the television programs, im- 
plementation of a paid commercial cam- 
paign to promote the program « establish- 
ment of an ACTION LINE feedback system 
to assist participants in solving and dealing 
with daily living problems, and development 
of a new program evaluation and research 
design not previously used tn ABE. 

RFD Will also be reporting in the coming 
months on a number of accomplishments 
that may lead to new approaches in ABE 
including the design of a broad scope, non- 
sequential curriculum system, a new concept 



of the role of the paraprofessional in ABE, a 
new design for the training of paraprofes- 
sionals and a new design system for loose- 
leaf content units. 

We believe RFO has been one of the 
leaders in crystatizing the life-oriented ap 
proach to ABE. a philosophy that centers 
ABE around coping and living skills rather 
than just literacy training. 

Some of the elements of RFD have been 
tried before. By combining them into a new 
system we hope we have demonstrated an 
improved method of reaching rural adults. 
And. we hope we have contributed a num- 
ber of new concepts that make the total 
package more relevant to the adult learner 

As we move into the evaluation stage of 
the protect we will learn if we succeeded 
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OBJECTIVE FOR 
HOMEViSnORS CHANGES 



QUESTION: Ont of tht original objK* 
tivif of RFD was "that Associatt Taachars, 
asa ratult of thair participation In RFD, will 
wiih to prograii f urthar in tha taaching f iaW 
through a formal taachar-training couria/' 
What hat happanad to that objactiva? Ara 
RFD homa-vi$itor« baing praparad in tome 
way for a taachii :g caraar? If lo, how? And 
if not, why not? 



ANSWER, from Associate Director 
Vincant Amanna: 

RFD cannot ba dascribadasaxparimantal 
rasaarch. Instead RFD is a form of applied 
research which permits changes in design as 
the undarlying concepts move toward imple- 
mentation in the field test. It is true that 
the early conceptualization of the design 
included associate teachers. However, over 
time it became clear that instruction was 
not as central for tha role of homo visitor as 
possible some other concerns. 

We seriously questioned whether it was 
the taaching function, in the strictist sense, 
that we wanted to bring to the adult. 

Teaching is a very involved set of pro* 
cesses requiring 9 tremendous amount of 
skill. It seemed that this function was some- 
what incongruous with some of the things 
Are had assumed about those individuals who 
A^ould be the primary target audience for 
RFD: 

1. The participant wants factual infor- 
metton which he can apply directly 
and immediately to solving his prob- 
lems. He is not interested in deferring 
gratification. 

2. The participant is not interested in 
learning more than he can apply 
immediately. 

3. The participant <s not interested in 
being tested to see how much he 
has learned. 

The quality of the relationship between 
he participant and the individual who 
/ouid facilitate his learning was far more 
nportam than insuring that this facilitator 
^*ERiC *"'** teacher. 



Our facilitators emerged as friends and 
confidants rather than teachers, counselors 
or therapists. They came to ba viewed as 

individuals who could bridge the gap Le- 
tween sub cultures, who would be open, 
warm and accepting in their relationships 
with the participants and who would help 
the participants identify those aspects of 
their lives which could be made more 
meaningful through the acquisition of addi- 
tioHdl information and the development of 
new strategies. 

To prepare the facilitators for their role, 
we had to sensitize them to themselves, 
personally as hum^ „ to their interrelation- 
ships with others and to their rotes as mem- 
bers of a compiunity. 

So you see, because we are 'engaged in 
applied research and therefore can evolve 
workable concepts as the basic design ma- 
tures, we were able to move to the func- 
tional concepts of the home visitor and 
away from the more formalized concept of 
the teacher, or as in this case, the associate 
teacher. 

Granted, in the process we abandoned 
any thoughts of the career ladder inherent 
in your question, but we may well have 
provided the home visitors with new skills 
and information about himself and others 
not readily available to him elsewhere and, 
in the long run, of more lasting significance. 



„RFDan 

nstmciional process..' 

Associate Director Stephen Ud^ari 

QUESTION: Two definitions of Adult 
Basic Education have been published by 
RFD. One substitutes the phrase "instruc- 
tional process" for "institutional program." 
Would you explain the distinction and indi- 
cate which definition you prefer. 



ANSWER, from Associate Director 
Stephen S. Udvari: 

Before attempting to enunciate a state- 
ment of philosophy for RFD, it was felt 
that a working definition of Adult Basic 
Education was in order. Most definitions 
of ABE being used several years ago defined 
it in terms of program limitations and 
literacy skill acquisition. The very nature 
of the RFD program demanded a more 
dynamic parameter from which to operate. 
The following, then, is the definition: 
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Adu/t Basic Educstion is an instructional 
process of information and action in the 
continuing stntam of lifHong adtieation 
designed to provide experiences and 
skills to improve the quality of life of 
adults who are functioning at a level of 
performance and participation that does 
not permit their skillful use of available 
alternatives and their total involvement 
in today's complex society. 

This definition has been published on 
two separate occasions substituting inititu- 
tional program for initruetional procMS. 
The two concepts arc somewhat dichoto- 
mous. The very nature of the word institw 
tional connotes rigidity and traditionalism. 
For the most part, it is precisely this per- 
ception that undereducated adults hold 
about ABE programs. Furthermore, it it 
this aspect that thwarts adults from par- 
ticipating fully in institutional programs. 
Irt this same sense, institutional programs 
are organijed on predetermined sequential 
bases. The learner is committed to a lock- 
step movement from the beginning of a pro- 
gram to the end. In such an approach, the 
emphasis is placed on meeting institutional 
goals rather than individual needs. 

In the definition that I have proposed, 
the concept of instructional process is pre 
dicated on affective relationships rather than 
cognitive ones. In this instance, the words 
instructional process are flexible to also 
imply independent learning relationships. 
However, the essence of the concept is 
intended to mean a continuing development 
involving many changes in the learner - a 
process of evolving. Continuing develop 
ment on the part of the adult learner can be 
best affected through processes that permit 
random entry and self-determined exit when 
the need has been met. Instructional pto^ess 
then, is an individual relationship of the 
learner and what he needs to know. Where 
as. institutional program denotes many 
learners dealing with a single body of infor 
mation. 

RFD is designed to permit many learners 
to deal with many problem-solving relation 
ships. In short. RFD is a process that en 
courages the learner to personally prescribe 
his own curriculum in order that he may 
become Ready For Daily living. 
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DRECTORS 

EXPLAIN 

HOW 

RFD 

MEASURES 
SUCCESS 



COMMENT, from Director Boris Frank: 
Most adult educators and educational psy- 
chologists in this country tell us that adults 
come into learning situations to satisfy a 
specific need. Malcolm Knowles. for in- 
stance, in his book The Modem Practice of 
Aitult £ducetion indicates that need grati- 
fication and satisfaction are keys to reaching 
adults in educational situations. RFD is 
designed to satisfy particular needs without 
the individual having to go through an often 
unwanted comprehensive educational pro- 
gram. 

QUESTION: How do you know if RFD 
satisfied particular needs? It is understood 
that RFD is designed to meet such needs, 
but how will you know that it actually has 
met these needs? 

ANSWER, from Boris Frank: One is from 
indications from the clients themselves. 
Does the client feel that he has satisfied his 
needs? Who are we. for instance, as the 
educators, to always say that this person 
has or has not satisfied his needs? An adult 
can usually tell for himself if he has satisfied 
his needs. One of our measurements will be 
seif evaluatton. The University of Wisconsin 
Psychometric Laboratory will set up special 
methods of evaluating a program of this 
type, it will not be the traditional approach 
of grade level achievement or achievement 
Within reading levels or in math levels. How 
many people used RFD's services? How 
many people contacted other service agen* 
cies because RFD suggested it? How many 
people art physically doing things that they 
may not have done before? These are the 
types of behavioral change we will look for. 



QUltriON: This requires pretttts to find 
out what RPO members were doing before 
they joined the program. In other words, 
to determine behavioral changes, you will 
have to have information^ 'lout the adult's 
behavior before RFO. did RFD do 
for a pretest? 

ANSWER, from Associate Director Stephen 
Udvari: Firstly, we have rejected the tra- 
ditional methods of pretest and posttest 
evaluations because of the potential threat 
such tests have. One pretest we did employ 
was a check-list device which was non- 
threatening. It is a self-reporting index 
specifically designed not only to seek infor- 
mation but also to allow the individual to 
understand his own coping skill needs and 
development. Secondly, built into the con- 
tent materials were certain kinds of elicited 
action responses. For example, an earlier 
RFD survey revealed that undereducated 
adults didn't write or receive much mail. 
To utilize the mail as a strategy, we designed 
preaddressed postcards for requesting addi- 
tional information. The requests were 
answered through the mail. In a small way, 
this system set up a level of expectation and 
worked to create study habits. Further- 
more, some of the content materials were 
only translatable into action responses. For 
example, a bulletin on preparing a master 
mix could be completed only by sending^ 
for a book of recipes using the prepared mix. 
However, the major evatuatton wilt be 
achieved by comparing the treatment 
group's newly acquired behavior as the re- 
sult of their interacting with the RFD ma 
tertals, against the behavior of the control 
group who had no opportunity to interact 
with RFD materials. This method, applied 
to both groups, precludes the element of 
measuring success or failure; consequently, 
the responses tend to be more realistic. 



QUESTION: Many undereducated adults 
are reticent to explain their actions or their 
weaknesses; for example, they might say 
they actually use community services when, 
in fact, they don't. A self -report would be 
suspect for this reason, don't you think? 

ANSWER, from Boris Frank: t think you 
have to remember the element of the home- 
visitor. The home*visttor is the key to the 
entire evaluation process because she per- 
ceives what the situation was when she first 
went into the RFD member's home, and 
she sees what changes take place as she visits 
with the RFD member. And. specifically 
in the case of community services, we can 
check utilization with the various agencies. 



QUf STtON: Were the home-vtsttors trained 
to make these kinds of observations? 

ANSWER, from Associate Director Vincent 
Amanna: Yes. Concerning evaluation, the 
RFO home-visitor had two distinct func* 
tions. One function was to employ a pre- 
pared interview schedule at each visit. This 
data, based on questions of a fairly precise 
nature, was gathered over the 20 weeks. We 
couldn't go dashing into such tests; other- 
wise, we wouki have turned off the partici- 
pant. The second evaluative function that 
the home-visitor performed -and to me it is 
even more important than the first -was to 
be very sensitive about clues picked up while 
visiting. The home-visitors were trained to 
be sensitive to these clues about the \iffi of 
the participant, including the life of the 
participant prior to the advent of RFD. 
These were the two approaches RFO used 
to gather non-threatening pretest data. 
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RFD Evahmtion 

ReRecligns 
Pro and Con 
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At you know, this ti the ytar for RFO's evaluation. The evaluation will 
measure a wide range of behaviors that denote a change in coping skills, 
among them the use of RPO services and contacts with service agencies sug* 
getted by RFD. Persons receiving the personal attention of a paraprofession- 
al weekly visitor and the special RFD reading materials will be compared 
with those who only had access to media presentations. 

We asked two members of RFD's professional advisory board what they 
expect the evaluation to show. Both have definite, occasionally divergent, 
opinions. Their frank answers to this broad question reflect their individual 
concerns in adult basic education and in the implementation of the RFD 
program and its evaluation. 

Both men are specialists in adult education at The University of Wiscon- 
sin. Robert D. Boyd, professor of curriculum and instruction and former 
editor of Adult Education, was Associate Director of Continuing Education 
at Antioch College, where he co-directed adult education programs. His par* 
ticular interest is adult motivation. He visited all of the nation's major adult 
literacy education centers during 1964 and 1965, as a member of The Ohio 
State University research and consulting team on literacy education. 

Button W. Kreitiow, whose research specialty is change in social 
organizations, is a professor in the Department of Educational Policy Studies 
and in Education Extension. Among the projects he has directed are pro- 
grams on the improvement of adult basic education teachers, done under the 
auspices of the Wisconsin Board of Vocational, Technical, and Adult Educa 
tion. 
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What RFO's evaluation shows will be 
detef mm«d by what aspects are considered, 
if the mater tais produced are really evalu 
ated. this should be done in terms of the 
outcomes they were supposed to achieve. 
Assuming one objective of demonstration 
protects IS to upgrade the capabilities of low 
literacy adults, then an evaluation should 
get at whether or not the capabilities of 
these adults have been increased by contact 
With RFD This can be done at several 
ttfvels. The ultimate test of a program's 
succ^s in addtt basic education (ABE) is 
whether the adults contacted learn to read 
more effectively, learn to handle their daily 
and weekly crises, and learn to use personal 
^i-^i^V^ munity resources for continued 



I think we're not very likely to set the 
evaluation concentrate on these kinds of 
ffMasureflfients because they are hard to get 
at, and most federal programs provide too 
little time for their evaluation. What i ex* 
pact is a secondary level of evaluation - an 
klentif icatton of ingredients we assume are 
related to primary objecthres. WeaMime* 
for eMmpie, that because a person contacts 
other agencies more readily today than ha 
did last year that he has learned to handle 
his problems more effecthrely. I want to 
know whether RFO produced this action. 

One of the things that concerns me 
about the evaluation relating to the objec* 
tives is the expectation I have had all along 
of the difficulty any medium has of getting 
to people who need the message most. This 
is the problem every adult education agency 
has in reaching the under-educated adult. I 
expect RFO reached more non-target than 
target audience. Whether RFO's multi- 
media approach did reach the need group 
better than a well-established agency could, 
I don't know. I would be interested in 



finding out who was contacted, and a break- 
down by ability levels, education levels, and 
economic levels of a random sample of all 
persons reached by any means - both the 
target audience and others. Were coping 
skills more effectively developed among the 
middle class and tower middle class than 
among the disadvantaged adults in the geo- 
graphical area covered by the project? The 
lower middle class - of which very few 
meet ABE criteria - has a value system that 
is upward bound, but the disadvantaged, 
low literacy, tower class rural adults have a 

cultural pattern often tacking m thostf 
motives heki dear by the middle class 

The question of values must be raised 
in any ABE program. As educators, we tend 
to impose values, and assume that good old 
middle class values are right Our measure- 
ments often reflect what the middle class 
would do. This bias is not part of RFD's 
evaluation, as I have perceived it. but the 
project is so tied to values that its considera- 
tion would be usoful. as it would to almost 
any program with low literacy adults 



BEST con AIMIUBIf 

In tht past, evaluations of ABE 
df tnonstration projects and programs have 
ba«n limited by the amount of time that has 
to be spent on other things. A sound evalua* 
tion should be an integral part of all phases 
of a program, but whe i you run a program 
there are such priorities at producing ma* 
terieis. finding staff to do the job, and or* 
gantaring and administrating that are neces- 
sai y to keep the program moving. By the 
time the staff spends its energies on these 
problems, there isn't time to integrate 
evaluation. This is true of almost every 
ABE program I have ever seen, and Vnt 
afraid it's been true of RFO. 

Nople involved in ABE programs are 
committed to doing something now, end 
helping people in need often takes priority 
over reaching stated objectives. After the 
program is completed, the staff gets to the 
point where they can concentrate on 
eveluation. Then they're too late and are 
forced to use a lot of hindsight and do a 
iecond*level evaluation - an appraisal - 
rather than an eveluation directly tied to 
the objectives. 

In my way of thinking, the evatuators, 
whether insiders or outsiders, should have 
been involved in evaluating the program 
from phase one. I woukl like to see demon- 
stration projects put more emphasis on 
evaluation from the start. It's very hard to 
W whether RFD or any other demonstra- 
tion project is effective without a lot more 
evaluation effort. If we don't have sound 
evaluation, we end up as publicists for pro- 
grams we believe in r<rther than those we can 
actually prove. 1 say this because RFO 
probably has been more competent in its 
publicity role than in any other. Because of 
this, it is in danger of portraying a value to a 
program before the evaluation can substan- 
tiate or refute this value. A program whose 
staff has a lot of ability to publiciie will 
look good on the appraisal, even thou^ it is 
not tied to the achievement of primary ob* 
jecthres. The staff's commitment to the 
program will lead the observer to over- 
gMieralize on its effectiveness. Even pro* 
f esslonai obsenrers are fooled by publicity. 

I am rK>t sure wed publicized programs 
can sell reading and coping skills to the dis- 
advantaged. Can they sell a program of 
learning to low-literacy adults? Do these 
adults read better now? Oo they cope more 
effectively? Do they go to other agencies 
and. as a result, handle their daily crises 
better? I wish the evaluation of RFO would 
answer these questions. Perhaps it will. 

I believe that the multi-media 
approach to ABE is a sound one. and I hope 
we will have some clues as to its effective 
nes^from RFD's evaluation. 
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I think one of the basic things to come 
out of the RFD program is that we wilt 
develop techniques to reach those peopiC in 
the rural slums of America who have not 
been reached by conventional cooperative 
extension. Cooperative extension has been 
extremely successful with middle class 
people, so successful that it has driven many 
families without mkldle class values out of 
farming. That is my impression. Tm not 
rriticizing cooperative extension. They set 
Mieir goals and met them so welt that the un- 
successful farmer, partly because he did not 
take advantage of cooperative extension, 
found he could no longer compete with 
neighbors who used it. who even sent their 
sons to schools of agriculture to get advanc- 
ed degrees. The unfortunate thing is that in 
the meantinie some rural people have been 
made isolates. 

I see RFD as the first sincere program 
to reach out to thaae people and say, "We 
care about you and weVa going to try to 
help you help yourself I And we're not only 
concerned about you economically, but 
we're also concerned about you as people/' 
This message has come through. I think the 
evaluation will show that money spent to 
reach these peofrte with television, and 
especielly with home visitors, is mofiey ex- 
tremely welt spent. 

The evaluation also should reveal prob* 
lams these people have wliich we never 
dreamed they had - severe problems in 
interpersonal relations, in isoletion and 
economic s^egation, and in mental illness. 

The evaluation should reveal the need 
for integration amortg adult educators, social 
workers, and health authorities. It mrv 
show us that social and economic problems 
are too pervasive for the county agent, adult 
educator, or health authority to handle 
alone. It should show us additional ways 
specialists can work together. Although 
this wasn't its major thrust, RFD began to 
show how an adult educator can work with 
county authorities. If the evaluation doesn't 
consider this, it will have missed a significant 
factor, in my judgment. 

I think there was reinforcement from 
one medium to another. This is a sound 
principle of education, and one we sub* 
scribe to in our schools. We should begin to 
subscribe to it in adult education, too. It's a 
pity it hasn't been done before, in this 
sense. RFD is a pioneer in a practice which 
one would think agH^common. 
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I imegine the progrem reached a widi 
audience than Its Target Audience. The 
Americen viewing public is sometimes not 
as sophisticated as we would like to thirl , 
and the mkMIe class housewife who is not 
included in the RFD sample may have tune^ 
in and been a regular follower because of 
the format. All those hints and recipes wer 
extremely useful. The interviews with celec 
ritiM presented a side of them which you 
don't ordinerity see except on the lete-late 
shows. 

TN design is a good one. Itwasn't 
testing learning per se, but what kind of 
changH occur in the Ih^es of these peopla. 
Itasked, ''H I do this can I notice any 
changes in theee people^ even those I don't 
expectr By opening it up this way, it dM 
less violence to what wa know about aduH 
education. We really don't know if you do 
XdoyougetY,ordoyougetWorZ. To 
us as educators it is hist as maaningful if ym 
getZ. An anatogy Is whether children learn 
to read batter with Method A or Method B. 
They may learn Just as well with either . 
method, but tNir attitudes may be vastly 
different. With Method A thay may b»* 
tome excited and enthusiastie about reading 
but with Method B they may and up fedbig 
they just don't like reading any more. 

As f er as learning to read goes, we mav 
find that there is no difference between 
RFD's control and experimental groups, but 
there may be differences in self-esteem, 

community involvement, and so forth, and 
these differences mey be tremendous. Vi- 
carious achievements wilt be significant, not 
whether we got rid of illlterecy. It is more 
important to measure whether the indivklua 
is more self-initiating, involved in his com- 
munity , facing the realities of the worki, 
trying to solve his problems, and giving up 
his childish fantasy world. Does he have an 
enhanced self -concept? Does he pay his bit' 
now? Does he get to places on time, relate 
to people better, care about his heelth. use 
the resources in his community? Do others 
find htm a happier person? These are the 
significant factors, not only that he is a 
better reader. 

We have thousands of studies done by 
competent people that show you one 
method is about as good as another. What 
they find, however, is that attitudes make a 
differerKe. Most researchers don't want to 
touch attitude change beceuse it's "messy" 
and not as ''nice" as numerical scores on the 
California or Iowa Achievement Tests. . 

When it comes to measuring self- 
esteem. I am absolutely opposed to giving 
these adults paper and-pencil tests. These 
tests are far too threatening to an already 
very weak self-esteem, and are more apt to 
measure anxiety and lack of cooperation. A 
relaxed intetview with someone you trust is 
a far better measure of self-esteem. We have 
tested interview methods. There is no 
reason why we should rK>t use them. 
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DEVELOPMENT OF THE RFD 
CONTENT CENTER COMPONENT 
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Stevt Udvari 

Associate Oirtctor, RFD 



RFD's homt :tudv componant, tht 
Contsnt Cf ntsr Itsrning matorisls, was par* 
Laps its mot! difficult to implamant. Tha 
staff's initial af f ort was to assambfa a cora 
of curriculum matariats from tha many 
axisting cnmmarciaify publishad matariais 
for adults. At the and of a six-month 
raviaw of matariais. howevar, it was datar* 
mined that most of the materials were in- 
adaquate or inappropriate for RFO. 

Steve Udvari. associate project direc* 
tor, discussed this and other facets of 
development in a recent interview. 

"Basically, problems of the content 
development centered around preparing 
relevant informational units for adults/' 
Udvari said. "Information was limited in a 
number of categories in which potential 
RFD participants expressed high interest. 
Many of the materials did not speak to the 
specific concerns of undereducated adults 
since they were prepared at a higher level of 
cOi'iprehens*on and sophistication. There 

however, a profusion of materials in 
the area of money management and the 
world of work." 

Just getting a job is no longer the 
overriding concern of the disadvantaged 
adult. Udvari said. There are many social 
services by which he can maintain his life. 
"The disadvantaged adult is becoming more 
concerned about improving the quality of 
his life beyond mere maintenance require* 
ments. He is becoming more concerned 
about intangibles such as greater job satis* 
faction, identity, status, and being able to 
control alternatives over which he feels he 
has very little control." 
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RFO also found that most existing 
adult basic education materials stressed 
reading and writing skill development. 
Udvari saki. "So many educators feel that 
teaching the individual to read and write 
will solve most of his problems. This is not 
so. Even our limited surveys indicate that 
reading, writing, and computation are only 
three of the many problems he must deal 
with, and they are quite low on his list of 
priorities. High on the list are those things 
that wilt help him improve the quality of 
his life." 

"We telt it very important to give the 
undereducated adult certain kinds of infor 
mation for strengtnening his identity, for 
developing his sense of self esteem and inde- 
pendence, and for effecting changes for him- 
self and his family. We found very little 
comnnerctally pioduced material to develop 
these characteristics - almost none." 

New Qoais 

A^ter six months of unsuccessful 
• searching. RFD decided it had to produce 
most of its own materials. It had a year in 
which to do this. During that year, content 
development staff was changed from three 
part time to two full time writers. 

The original goal of having all materials 
reviewed by experts and pretested on the 
audience for credibility, usefulness, and 
relevance was time-consuming and encum- 
bering, lesting of nruiterials was finally 
limited to the actual demonstration phase 
of the project. 

RFD's materials contained one major 
concept per unit. Udvari said, and were 
written at the independent study level 
(fourth to sixth grade equivalency level) ir 
clear, concise, journalistic language to which 
adutts are accustomed, since this ts the 
manner by which they receive most messages. 



Jantt Laibfe 
Conttnt ^cialiit 



To fulfill thesd objectives, a journalist, Janet 
Laible. was hired as a content writer. 

"RFO's printed materials stressed 
adult orientation and used quality illustra- 
tions, layout, and design/' Udvart said. 
"Many locally and commercially produced 
materials were of such poor quality that 
they reinforced a poor perception of self* 
fisteem and demeaned the adult learner/' 

"Wff fried to eliminate rote and repe- 
tition/' Udvari said. "W0 did not want to 
develop a workbook format which simply 
measured immediate recall or Information. 
This type of format does not assist the 
learner to assess the usefulness or trans- 
ferability of information into problem 
soiving situations." Rather than ask adults 
to fill m the blanks. RFD tried to get them 
to translate information into action by 
applying it immediately as life coping 
strategies. 

"For example, when we talked about 
emergency telephone numbers, we included 
a self -adhering label which the person could 
use to write the numbers on and attach to 
the telephono. When we talked about com- 
parison shopping, we invited the person to 
examine her shopping practices by com- 
paring brand name prices with store brand 
prices. 

"The whole emphasis was on coping 
skills and behavioral change rather than 
literacy skill development." 

A set of five three-ring binders was 
designed to hold the RFO materials and 
other supplements the individual might col- 
lect. The binders contained pocket inserts 
convenient for holding clippings, brochures, 
and pamphlets. The learner was encouraged 
to prescribe his own course of study and 
compile his personal "encyclopedia of life 
coping strategies/' 

"There might be a tendency to believe 
the materials were female-oriented/' Udvari 
said. "When we designed them, we tried to 
emphasise a total family orientation. In 
planning a menu, for example, we designed 
a game to involve all family members in 
considering good nutrition. 
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"There is a tendency for the woman in 
the rural Wisconsin family to be more in- 
terested in iducetional pursuits than the 
man/' Udvari said, adding that wives have 
four years more schooling than their hus 
bands. "They aUo read more books, maga- 
jrines, and newr^apers than their husbands/' 
he said. "Thf.y have the inclination and time 
to deal with printed information." 

Production Probltnu 

Production of original content ma 
terials was a problem from the beginning. 
Udvari sakl. 'The basic problem was that 
wc auumed far more than we were able to 
logically produce. Our original curriculum 
offering consisted of 124 units or informa 
tion. We streamlined the Content Centers 
to include 72 units, and even this was an 
optimistic projection.. Producing materials 
of this quality and quantity for adults may 
take six full-time writers three years to 
accomplish." 

By the end of the 20-week field 
demonstration, the content staff completed 
14 original units formally printed on sub 
jects of high adult interest, Udvari said. It 
sent out an additk>nal 15 units in typed 
copy form Suitable commerciaily published 
materials were ordered to complete the 
Content Center listing and made available 
to participants. 

Materials were free and sent to anyone 
who requested them. To simplify ordering, 
there were preaddressed, stamped postcardt 
in the loose-leaf binders that only required a 
name and address. Although these binders 
and order cards were sent primarily to the 
100-member treatment and control groups, 
over 1.478 cards were returned requesting 
materiaU. Units mention^ by home visitors 
and on TV were requested more. Udvari 
said, which may indicate that human inter 
action is needed to motivate people and 
convince them materials actually are free. 

Although requests for materials were 
far greater than anticipated. Udvari said, the 
project filled all requests received during its 
five-month demonstration period. People 
were notified when materials were delayed 
or unavailable 

During progrum implementation. 
12.944 items were distributed to partici 
pants. Most of the materials went to persons 
who were highly motivated to seek mfor ma 
tion and who knew how to process it. 
Udvari said. "What this may indicate is the 
pervasive need for adult information ^St^Hlmn 
wtth life coping skiUs at all v>m^! iifvffi-. 



THE RFD SYSTEM 

THE MEDIATED DELIVERY SYSTEM 
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INTRODUCTION 



ror. J^^^ six-part series explains an educational system that 
can shape and personalize mass media to reach a disadvantaged 

aduUr?e1?;'?^'l}4^^"'^P°P"^"i^^- Ihe Iys?em c^ help ^ 
nJ^aiJf.i?*'"^'®*^^''^.*^^ computation while teaching them the 
practical and essential skills they want to learn and need L 
learn in order to cope with life aid its probleS The fvsJem 
incorporates the known principles of adult lea??iAg Sd tU 
effects of mass media. By capitalizing on the accfsfihii??v 
?Sfch?nr3i«L'' °5 5^^"^^ hal'gfea? potent uf'f or'' 

c^%1i?fon'i?1$^^^^^^^^ Se'?io1s!^''°"^ 

II c nrr? mediated system was developed during a three -year 
WifAoSfin''?.?^ Education project locited at the Unive^sUy of 
Wisconsin Television Center - WHA-TV. It used TV shows 

a"?oU-lref S^ih^i""?* t"* ' 'f"'^" ^ I^n'th^ Almanac. 

S! content of each element can be designed to 

oil H characteristics of any adult populltion. 

designed for undereducated aSd disad- 
s?2nf?*^*''»?*\,'?""*.^" """ties within range of the TV 

IJfS»ntf„J''^""^'''"^*y °* Wisconsin's televisioi station. 
Elements of the system are explained in this report as part 

?fi-^SLr°^*f* ? efforts to share its experience with others. 
ti^Ss^ttrlSs elVcti^eltsl?"''''" combination 
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Many planning sessions took place to coordinate the components of RFD. Here project director Boris 
Frank (right) confers with Steve Udvari, Vincent Amanna and Bob Leu, directors of home study, home 
visits, and television, respectively* 
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THE MEDIATED DELIVERY SYSTEM: 



Its original development and use 

The mediated educational system explained in this 
report was originally used to serve undereducated rural 
adults in four counties of southern Wisconsin. In rural areas 
of these counties, 43 to 51 per cent of the adults have never 
been to high school and one family in four lives at or below 
poverty levels. Like undereducated adults elsewhere their 
problems are not simply educational or economic. They con- 
front a wide range of personal and family problems that are 
intensified by stresses of low income and not knowing where 
to turn for help. Nor is their isolation simply geographical, 
for their limited reading and computational skills further 
limit their awareness of possibilities for improving their 
lives . 

Distance, pride, isolation, long working hours, sheer 
poverty and negative experiences in elementary and secondary 
schools are enough to keep them from going to adult literacy 
and mathematics classes. Yet most of them own TV sets, radios 
and telephones. Electronic media can and do penetrate their 
isolation. 

This mediated system was designed to combat their lack 
of motivation, isolation and shame of economic and educational 
handicaps. It combines a variety of electronic and print 
media with personal contact to deliver information to the adult 
in the privacy of his home, where he is free to choose what he 
wants to learn and by what means. There is no prescribed 
sequence or topic, no tests, grades or lectures. The system 
helps the adult develop those skills and pursue those interests 
which he feels necessary and relevant to his particular situa- 
tion. It helps adults learn what they want when they want and 
as fast as they want, and permits them to stop when they want 
or when their needs have been met, and to return any time they 
feel the urge. The system does not have "drop-outs." 

The system uses six major components: 

* a weekly half -hour TV show 

* a wide array of information bulletins 

* personal contact in the form of weekly home 
visits 

* a weekly radio program 

* a monthly Almanac 

* a toll-free 24-hour telephone service for answering 
questions and requests for materials 




The RFD delivery system brings information to adults by television, printed bulletins, home visits, radio, 
Almanac, and telephone. 
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The system can help adults learn new ways to cope with life in areas of nx)ney management, nutrition, 
child development, consumershtp* interpersonal relations, employment, home maintenance, dealing with 
agencies, and any other adult concern. 




Each component could stand alone. They were more 
effective, however, when used in combination by a partici- 
pant • and participants were always encouraged to use all 
components available. 

The original test of the system was the RFD or Rural 
Family Development Project. Before Implementation the staff 
personally contacted officials in agencies and government to 
explain RFD's purpose and solicit their cooperation. They 
asked social welfare agencies for names of undereducated 
adults, who were contacted individually and invited to take 
advantage of home visits. They launched an extensive public- 
ity campaign to promote RFD as "information and action for 
adults" to encourage participation by adults of all back- 
grounds in order to avoid stigmatizing undereducated parti- 
cipants . 

The system*s media and its ongoing promotional campaign 
introduced topics covered in the informational bulletins and 
tried to motivate adults to pursue any subject of interest 
by writing or calling RFD. The media also informed them of 
Action Line's free telephone service available at all hours 
to help with any problem or question, as well as for ordering 
bulletins. 

During the 18 months of planning, the staff designed the 
form and content of each element in the system to fit the 
target population, using data from field surveys and other 
sources. By asking disadvantaged rural adults what they most 
wanted to learn, the staff discovered it had to present prac- 
tical information on how to cope with life and its problems, 
not traditional subjects like spelling and grammar. The staff 
designed a comprehensive curriculum of "life coping" informa- 
tion that included anything an adult might want to know about 
health, nutrition, safety, sanitation, first aid, employment, 
money management, child development, interpersonal relations, 
and other topics. This information was available in single 
concept bulletin form that permitted the adult to choose what 
he wanted to learn. Any adult could phone or write RFD to 
order a bulletin, which he could read at home on his own. 

The RFD television shows contained practical information 
in a bright and fast -paced format. There were 15-20 different 
segments per show, many very brief, some three or four minutes 
lon^. Television entertained while it informed viewers of 
available agencies and other resources in the four counties, 
showed viewers practical hints on home maintenance, nutrition, 
shopping, and other subjects, and motivated them to order 
bulletins and phone Action Line. Johnny Cash, Burl Ives, 
Dr. Joyce Brothers, Chet Huntley and other stars made regular 
appearances . 



Home visitors assisted the participant in ways the 
system's media could not--as friends and confidants. They 
facilitated use of RFD's services as they tried to help 
the adult in any way possible. RFD selected its team of 
eight paraprofessional visitors from persons recommended 
by social agencies and respondents to "help wanted" adver- 
tisements in the four counties. 

The system's monthly RFD Almanac was sent to rural 
adults to stimulate their participation and deliver infor- 
mation relevant to their needs. Its radio programs served 
a similar purpose. 

Briefly, this was how the system functioned during its 
first implementation. It is a system that permits a program 
to reach a hard-to-reach adult population conveniently, 
privately, personally, without embarrassing the participant. 
It allows the participant to select the media and form of 
delivery best suited to his needs. 

The system is flexible and has promise for continuing 
education of adults of all backgrounds and needs. RFD was 
educational program with the answers for education 
of the undereducated adult, but it was one innovative attempt 
to design and utilize mass media to help meet the needs of 
adults in a down-to-earth, practical and personal way. 

This report does not answer all questions about a program 
of this type. It can only introduce the subject and suggest 
ways that worked in a test situation. Successful development 
of a similar program depends upon your particular needs and 
circumstances . 

The RFD staff sincerely hopes that its experiences will 
be useful to educators, social service workers and commun- 
icators who realize the potential of mass media for continuing 
adult learning. 
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INCORPORATINC PRINCIPLES OF ADULT LEARNING AND MASS MEDIA 

The system was carefully plaimeU to incorporate known 
principles of adult learning processes in order to increase 
its educative potential. i 

1. Learning tends to be valued by an individual to the 
extent that a high valuation is placed on learning by those 
elements of his culture that are important to him. This 
suggests the importance of the home visitor or similar per- 
sonal contact. *^ 

2. An individual tends to be motivated to learn to the 
extent that he perceives the need for self-diagnosis of 
learning needs and self -evaluation of the learning process. 

3. An adult tends to resist learning to the extent that 
his self. concept as a self-respecting, self -directing organism 
is threatened or violated. This principle indicates the 
importance of involving learners in the process of planning 
their own learning expe:riences and making decisions about use 
of the media and their content. 

4. An adult tends to enter into a learning activity with 

a problem-centered orientation— with the intention of immediate 
application of his learning to the solution of life problems. 
This indicates that adult learning experiences should be 
organized around problem situations defined by the learners 
themselves and that material presented through media should be 
organized according to a problem-solving sequence rather than 
a logical subject -development sequence. 

5. An adult tends to internalize new learnings to the 
extent that he is able to incorporate them into his experience. 
This indicates the importance of content that is directly 
applicable to the life situation and needs of the adult. 

The system addressed itself to one of the most perplexing 
variables confronting all programs to help adults improve com- 
munication and computational skills: the problem of motivation. 
This ruled out traditional pedagogy in most of its forms. A 
^J®?5^^u®^ sequence or curriculum, tests, grades, lectures, 
childish materials, formal classes, rote memorization, quizzes 
and grades recall past school failures and boredom. Tradi- 
tional pedagogy is bad enough for children who have no choice 
in the matter, but it is lethal to a voluntary program of adult 
education. / f b 



1 

Adapted from Malcolm Knowles, "Adult Education," In Rossi 
Peter H. and Bruce J. Biddle (Eds.), The New Media and E ducation 
Garden City, NY. Anchor Books, 1967, pp. 348-9". 
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Adults also want to participate in programs at their own 
convenience, when the subject matter interests them and when 
their interest is at a peak. Hiey want to come when they can, 
leave when they want to or when their needs have been met, and 
return any time they feel the urge to learn more. Traditional 
methods may force adults to drop out simply because they miss 
several consecutive classes or fail to move sequentially from 
one grade to another. These obstacles to adult learning are 
overcome by this mediated system which can deliver information 
directly to the home in a variety of forms when the adult wants 
that information. The system enabled the participant to select 
those components that best met his needs* 

The system also incorporated the capabilities of mass 
media. Research on the effects of specific influence attempts 
shows that mass media can produce changes, especially in the 
areas of knowledge and attitudes, but that these changes tend 
to be temporary unless reinforced in some way, and that the 
strength of impact is greatly affected by such factors as the 
status and credibility. of the communicator, the qualities of 
the communication, the predisposition of the audience, and the 
degree of audience participation. 

"Hie system was shaped to maximize impact based on the fol- 
lowing principles: 

1. The more a program reinforces the needs and attitudes 
of people, the more successful it will be. 

. ?• content of a program reinforces what an 

individual has experienced, the more successful it will be. 

3, The more the content of a program reinforces needs an 
individual expects to face in his near future, the more success- 
ful It will be. 

4, The more the content of a program takes advantage of 
reinforcement from other media and the immediate social situa- 
tion, the more successful it will be. 

5, The more the content of a program reinforces needs 
which relate to specific role or things we do, the more suc- 
cessful It will be among those who take those roles. 

6, The more frequently and the more recently the content 
of a program reinforces needs, the more successful it will be. 

7, The more a program reinforces needs so individuals will 
resort to books or to other sources for further reinforcement, 
the more successful it will be. 
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-vx^^^X^^ ^* ^* Swanson, "Guides to Success in Educational 

TV, R.B. (Ed.) "Adult education and mass communications." 
Adult Education . 1953, 3, 127-31. 
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8. The more immediate or pleasure -giving the rewards 
offered to individuals by the content of a program, the more 
successful it will be. 

9, The more emphasis upon, and use of, delayed -reward 
subject matter in a program, the greater the intellectual 
ability required of the audience. 

10. The more the key ideas, the major themes, the essential 
information in a program are translated into visuals, the more 
successful will the program be. 

11. The more information and the greater the complexity 
of Ideas m a program, the more intellectual ability will be 
required for learning. 

12. The more the personalities in a program appeal to 
individuals, the more successful it will be. 

13. The easier the physical availability of programs to 
individuals, the more successful they will be. 

14. The more advance notice the persons in a potential 
audience have of a program, the more likely they are to attend 
to It. 



Although adults may be impoverished for a variety of 
reasons and under many different conditions, they are still 
individuals coping as best they can with what their lives 
present. The question remains, then, whether services can 
be set up so that adults who use them become participants 
rather than recipients, approaching projects with dignity 
and, in turn, being accorded the dignity they deserve as in- 
dividual human beings. Given a chance to participate in 
programs that are attuned to their needs and that approach 
them with respect and consideration, even very burdened 
adults make good use of educational experiences. 
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ASCERTAINING PARTICIPANT WANTS, NEEDS AND INTERESTS 



One of the advantages of this mediated system is its 
ability to speak directly to the wants, needs and interests 
of the adult as he perceives them. This is not only possible 
but essential. Adults are motivated to learn to the extent 
that they see the need to learn and the rewards of learning. 
The preceding section on characteristics of adult learners 
and mass media strongly indicates that the more a program 
incorporates the wants, needs and interests of the adult 
target population, the more effective it will be. 

If a project is to address itself to these wants, needs 
and interests, it must ascertain them directly, by going to 
the potential client. This is not only obvious but crucial. 
If the system simply becomes a vehicle for transmitting infor- 
mation that professional educators or others think adults 
Should know or want to know, its program will attract fewer 
participants and be hampered in meeting the needs and interests 
Of those It does attract. A prescriptive curriculum sets up 
barriers to self-directed learning. It reinforces the per- 
ception of disadvantaged adults that they have little or no 
control over their lives and that their own concerns and in- 
terests have little validity. In short, although a prescrip- 
tive curriculum is traditional and more easily implemented. 
It limits the outreach capability of a mediated system and 
prevents adults from learning that their needs and interests 
are legitimate bases for acquiring knowledge. 

There are several methods for determining the potential 
client's wants, interests and needs. Whatever the method or 
methods used to gather this information, care must be taken 
to maintain the dignity and integrity of the respondents, who 
must be made to feel that their opinions and feelings are 
valued and that they are contributing to the good and well 
being of others. Discretion must be used in probing under- 
educated and disadvantaged adults, who prefer to remain anon- 
ymous and who are easily threatened by direct methods of 
questioning. 



Preliminary Data Gathering Methods 

Peripheral observation - -One method to ascertain client 
needs is periptierai observation. This can be done by record- 
ing the feelings expressed at local gathering places such as 
employment offices, welfare offices, co-operatives, retail 
stores, bars, auctions, fairs, churches, post offices, etc. 
An RFD observer recorded the feelings he overheard while 
riding trucks for milk pickup and surplus food distribution. 
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Interyiews- -Another method to ascertain needs is the inter- 
view. Which can be a casual conversation or a structured inter- 
view administered by paid interviewers. u^i.uxeo ini^er 

Assemblies --Another method to gather preliminary indica- 
tions oT^TTcnt needs and interests is the assembly or meeting. 
This may include welfare rights groups, civil rights groups, 
parents* groups, labor unions, and any other meetings which 
potential clients are likely to attend. 

Survey- -Another method for gathering preliminary data is 
the survey. The survey method, which tends to be costly, should 
be designed and conducted by professional survey practitioners 
using questions derived from observation and interviews. RFD 
used a telephone survey conducted by the Wisconsin Survey Re- 
search Laboratory of the University of Wisconsin-Extension. 
Respondents were 60 rural adults with no more than an eighth 
grade education. The RFD survey served a dual purpose --ascer- 
taining the wants, needs and interests of the respondents as 
well as their media habits (the following section elaborates 
the survey of media habits). 

Questions on the wants, needs and interests of respondents 
probed the ways in which they interact and cope with the out- 
side world to get information and satisfy needs: 

Do you figure your own income tax return? 

use the yellow pages? 
have a checking account? 
budget your expenses? 
use the library? 

There were questions on leisure activities and on the interests 
m specific coping skills: 

Do you think programs in the area of family life such as 
making yourself and your home more attractive would appeal 
to people living in rural areas? 

How about the area of home management like- -how to buy 
wisely and buy on credit? 

How to save and invest money? 

Dental health and care? 

How to earn money during retirement? 

Understanding how our government works? 

Finding out what services are available for people living 
in rural areas? 
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if^el ??L5at.^ii''f respondent's age, educational 

;f)^! ^'^^^^ interest in continuing educa- 

8i?2ati^^^'' children living at home, and employmint 

Determining priorities of need 

^n^^^?^"^^"*^®'^® ^^^^ methods of gathering preliminary 

ina ""l^^ discover the follow- 

mg categories of needs: 

of mynro^' """^"^ * ""^^^ ^^^^ stomachs 

a^t J.ll^ M^^ffi^^T^ "^^^^ » good education I could 

lit Tore ll^y ^ °^ ^^^^ ^^^-^-^P I coulS 

Postponed or denied needs ! "Some day I'll save enoueh for 
?o'eIt'^irsT"^^"f'""^" 'J^^'^ ^ educl?Ion Su?'? got 

i;®^^ step in shaping the system to respond to client 
sSmLJ preliminary need indications into 

«c5^t?LT^^ ?° ^^^^ ^° potential participants and 
ask them to rank them according to their interest. This rank 
by RFD?^ interests may be done with a card sort, as used 

The card sort 

The RFD staff translated the personal wants, interests 
tfuZl^' potential clients intS specific behiviSJiriuch 
as Dealing with door-to-door and phone sales," "My emotional 
and mental health," "Getting more fun out of life?" and "hSw 

Sere^rnnlnTfS^/S''^';" ^T^''^ ^^^^ P^^cess similar items 
.tlff^^^^S ^!^?n.^^ P'^^'^^y worded items stated clearly. The 
^^^5 Produced 104 separace items, each printed on a separate 
^tlz: .1 ^^^^^ ^^J® grouped into five decks according to 
^^nn? concern: about oneself, about others, about the home, 
f n^lTcI^' surroundings. The staff fSrmulated 

a precise ranking procedure and asked potential clients to 
^^""^ systematically into five piles - -greatest 
^"""^ interest, general interest, poor interest and 
least interest--according to their own priority of interest. 
Each respondent received an inexpensive pen and pencil set 
lor nis erzorts. 



The 
to tell 
and th 



he card sort procedure permitted the potential clients 
.r.A f ^^^^^ ^o include in media content, 

and this rank ordering was the basis for developing content 
of electronic media and home study materials. ^ content 
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1*1. sort revealed that traditional school subjects 

like reading and spelling were low on the list of adult prior- 
ities (see chart) . At the head of the list was "living 
within my means," followed by "what do I live on when I re- 
tire," "smart food buying," "looking for a job," and "how I 
can become a better person." Adults wanted to learn how to 
solve problems they faced in life in areas of identity, human 
relationships, money management, employment and comprehending 
society. In effect, they wanted a life-coping skill curriculum. 
It is important to note that the RFD staff and other adult 
education professionals took the card sort in an effort to 
predict the results of the client group. None succeeded. This 
reinforced the point that professionals should not rely on 
their own concepts of need but should go to the source --the 
potential client himself. 



Card sort survey item analysis 
of rural adult priorities 
Top 14 items of 104: 

1. Living within my means 

2. What do I live on when I retire 

3. Smart food buying 

4. Looking for a job 

5. How I can become a better person 

6. Understanding insurance 

7. Family health 

8. My responsibilities as 

9. PollutionI Population! 

10. The joy of good food 

11. Growing old 

12. How to build character in my children 

13. Spelling better 

14. Using better English 



a citizen 
Conservation! 



The basic premise of the mediated delivery system is that 
adults can be taught to read, write and compute through a 
system that presents information on how to cope with the press- 
ing needs adults experience in their own lives. Each commun- 
ications medium can relay information on these verified adult 
interests. During the field test, the RFD project could 
, deliver anything an adult might want to know. Practical infor- 
mation such as how to start a car in winter, manage a family 
budget, look for a job, cook nutritious and inexpensive meals, 
grow tomatoes, and kill box elder bugs. Personal information 
such as how to develop character in children, apply for welfare, 
live with an alcoholic spouse, and seek marriage counseling. 
Telephone and personal contact components accommodated any 
adult learning need, from the highly personal or specialized 
to the academic in the sense of reading, writing and arithmetic 
lessons. Telephone, mail, and personal contact are the system's 
feedback components and permit the entire system to respond 
to new needs as they arise. 
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ASCKUTAINING PARTICIPANT MASS MEDIA HABITS 



In order to use media most effectively, designers of a 
program must ascertain which media are used by the target 
population, including how media are used, when they are used, 
and specific likes and dislikes. RFD used a telephone survey 
to sample media habits and preferences of the rural under - 
educated adults in its four-county target area. Of 60 respon- 
dents 

1001 watched television 
981 listened to the radio 
93% read a newspaper 
85t read magazines 

The television program preferred by most respondents was the 
news program (38%), ahead of comedy (17%), westerns (15%) and 
sports (15%). The RFD staff speculated that the popularity 
of TV news may be related to its utility and format. Tele- 
vision news is the means by which most adults obtain informa- 
tion about the world. Its brief segments permit viewers to 
wait for and attend to those portions of particular interest 
to them. The RFD television shows used a quick-paced "magazine" 
format and short segments similar to TV news, rather than using 
drama, features, or other format. The TV shows mixed informa- 
tion with entertainment as TV news mixes hard news with soft. 
In addition, the news anchorman, who provides continuity to 
TV news, was incorporated into RFD's television programs as a 
TV host who introduced each segment and presented some of the 
information himself. 

The hours and frequency of the RFD television shows were 
determined by responses to the following questions: 

Vfhat days of the week do you watch TV the most? 

On weekdays, that is Monday through Friday, during what 

hours do you watch TV the most? 

On weekends, Saturday or Sunday, during what hours do 
you watch TV the most? 

Questions on the popularity of local television stations assisted 
the RFD staff in placing promotional TV spots. 

Radio programs became an important part of the RFD mediated 
delivery system, although less important than the television 
shows. Survey questions probed the popularity of local radio 
stations to indicate optimal placement of radio programs and 
promotional radio spots. 

The RFD Almanac, a monthly four-page tabloid, became the 
project's newspaper, capitalizing on the high ranking of news- 



papers as an informational medium for the target population. 

Whatever method is used to ascertain media habits and 
preferences of a target population, its results can help a 
project shape media format, placement, and content in order 
to attract and hold the attention of the intended audience. 



COST PER ELEMENT PER WEEK 

The RFD staff has broken out the approximate costs for 
each element of the system based on a similar project and on 
the following premises: 

* weekly TV shows 30 minutes long and aired four 
times a week 

* one full-time salaried Action Line supervisor 

* production of a v/eekly public service radio program 

* production of a weekly Almanac 

* weekly home visits by paid paraprofessionals to 
50 clients 

* one full-time salaried supervisor of home visitors 

Obviously, there are many possible cost variations. Volunteers 
will be readily available in some areas. Existing staff can 
fill many positions. Production costs can vary widely. More 
extensive service areas can increase costs. This cost break- 
down can be used only as a general guide within the context 
and framework of the RFD project in the area surrounding 
Madison, Wisconsin. 

Given the above, the weekly expenses are $8,323.00. 
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COST PER ELBMENT PER WEEK 
CENTRAL STAFF 

Project Director $ 300.00 

Secretaries 125.00 

Office and Administration \ \ 250.00 

Travel 50.00 

'^^'^^^ $ 1,075.00 

TELEVISION PRODUCTION 

Director j 120.00 

Producer/Writer and Production 

Assistants 40o OO 

Studio Costs 550 !00 

JalejJ 175.00 

Graphics 73.00 

Tape and Recording 934.00 

Television Film Production: 

Services 1,100.00 

Stock and Processing 796.00 

Animation 200.00 

Stars 750.00 

TOTAL $ 5,098.00 

ACTION LINE 

One full-time supervisor $ 150.00 

Phone charges (2 lines in and 2 out) . 75.00 
Office Expenses 75.00 

TOTAL $ 300.00 

RADIO PROGRAMS 

Production of Tapes (10 stations) ... $ 75.00 

Personnel 50. oo 

Office Expense 25.00 

TOTAL $ 150,00 

ALMANAC 

Production $ 350.00 

Printing (10,000 run) 300.00 

Office and Overhead 300 .qq 

TOTAL $ 950.00 

SUB TOTAL $ 7,573.00 
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COST PER ELEMENT PER IIBBK, continued 

Cost estimates, continued 

SUB TOTAL J 7.573.00 

HOME VISITS 

Supervisor S 250 00 

Office Expense and Overhead ! 7s|oo 

Weekly cost per visit 

Visitor $ 4.50 

Travel 2.50 

Materials 50 

Overhead i.qq 

Total per visit . . • $ 8.50 

50 weekly visits $ 425.00 

^^^^^ $ 750.00 

TOTAL WEEKLY COSTS , 8.323.00 
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THE RFD SYSTEM 

AGENCY COORDINATION AND MASS PROMOTION 
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Project director Boris Frank (right) and other stafT met with officials in government, social service agen- 
ci-s. and other groups to tell them about RFD and ask for their cooperation. 
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AGENCY COORDINATION 



A significant feature of the system is that it is not 
confined to some obscure classroom, but uses the home anU 
the community for continuing education. This in itself is 
an ii^novation in adult education. Many adults do not know 
the resources that exist in their communities for recreation, 
education, social welfare and other services. It was not 
designed to replace existing community agencies and services, 
but to help potential clients use these agencies as part of 
the overall goal of helping the individual help himself. 

Members of the original target population were rural, 
undereducated adults in great need of assistance from social 
welfare agencies but unlikely to seek help from these agencies. 
The RFD project tried to inform them of agencies available for 
dealing with problems of employment, consumer complaints, wel- 
fare, government, education, mental and physical health, and 
legal assistance. 

Before embarking on this aspect of the project, the staff 
had to prepare agencies for any increase in workload that 
might result. Before and during implementation, members of 
the RFD staff met with local, county and state agency super- 
visors, government officials, and their staffs to inform them 
of the project's objectives and its progress. 

These efforts were particularly necessary for RFD's tele- 
phone quest ion -answering service (Action Line) which referred 
questions and potential clients to appropriate agencies. This 
coordination is essential to avoid suspicion and antagonism 
that can be bred by ignorance. Keep agency professionals in- 
formed. Solicit their advice and participation. It will pay 
substantial dividents throughout the program. 
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MASS PROMOTION 

The Promotional Campaign 

A public promotional campaign is a necessary expense to 
publicize services and recruit participants. RFD's promotional 
campaign was directed to all adults, to avoid stigmatizing 
undereducated, rural adult participants. It avoided mention- 
ing home study or anything that might identify RFD with tra- 
ditional school methods which most undereducated adults have 
learned to avoid. 

The public campaign began after the staff had contacted 
community leaders and social service agencies personally to 
request their support. At that point, the project began to 
implement its detailed promotional campaign using paid and 
public service announcements in radio and television; news- 
paper features, releases and advertisements; contests; dis- 
plays at county fairs; posters; photographs; billboards; a 
press conference; and handouts. The major publicity medium 
was commercial television, with advertisements appearing on 
the most popular stations in prime time 30 -second spots. 
RFD's popula* television host began to personify RFD, appear- 
ing at fairs and in photographs advertising the project and 
its services. 

The project's name and symbol had to appeal to its target 
population. "RFD" was chosen because of its relevance to the 
rural audience. "RFD" was easily developed into a readily 
identified and trusted symbol, the outline of a rural mailbox, 
which appeared in all television presentations and on all 
print materials and stationary. The RFD slogan, "RFD is 
information and action for adults of Southern Wisconsin," did 
not single out undereducated adults. 

Throughout the field test, RFD used its own almanac, 
television show, radio spots, and home visitors to encourage 
participation. 

The following three-stage promotional campaign was pre- 
pared for RFD. Each stage is timed in relation to the TV 
show, which designated the beginning of implementation, and 
promotes TV more than Action Line or home study materials per 
se. In order to plan a promotional campaign a project must 
know the demographic characteristics, biases, and media 
habits of the audience and the characteristics of available 
promotional media. Since an education program is a public 
service program, it may solicit cooperation and help from 
media and other institutions such as churches, civic groups, 
schools, industry, social service agencies, governmental 
agencies, etc. 
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MAKE IT GOOD 



RFD is a new television s( 

^^FO ts feammg at home 

RFD is information and 
, action for adults. . . 

money-savers, hints, shb 
tips and much more. 




TdnrWM Sertoli 



RFD 



news release 



•taVtf two:)** 1% 



f«iUU| M« Mm«t«« Mbit. U 




Whatbin RFOforMo? 




. Y«k I «Mm to know mom *out RFO. 



news release 




Rural Education 
is a three-way street 



RFD 



RFD 




Kf'*I) used a variety 4>f printed materials in its promotional efforts. 



Phase One : Prom Three Months to Show Date Minus One Month. 

* Begin contacts and photography leading to local farm 
feature magazine articles to appear no earlier than four 
months before kickoff. 

* Press releases on progress to professional journals 
keeping up their interest and providing a growing feedback 
of information. 

* Build up stock of project photos, particularly action 
and production shoes. 

* Have writers begin work on project biographies (one 
story should be, in effect, a fact sheet giving name, rank, 
serial number of personnel, important dates, details of 
government backing and cooperation, etc.i the second one should 
be a 1,000 -word feature on what the project is about, including 
anecdotal materials and emphasizing the unique aspects of the 
project) . 

* Work up "column items" to be held for release. These 
should be either ver> important, or light and bright. It is 
important to keep a file. A lot of funny things happen that 
would make copy, but are forgotten two months later unless 
written do%m. 

* Begin work on envelope-size one -page mailer to be 
enclosed in telephone bills, pay envelopes, USDA mailings. 
This mailer should include purpose of shows, duration, start 
date and times. 

* Contact civic organizations that will cooperate in this 
mailing activity. 

* Ask for cooperation of and coordinate public relations 
departments (government and industry) representing agencies 
involved. 

* Set up program guide and TV Guide story and pix. 

* Begin negotiations with other TV stations for use of 
promotional spots to begin two weeks before series airs, 

* Continue speeches by project director and other staff 
before any and all community groups on program's function, but 
discourage news coverage at this point. 

* Keep a press clipping book. 
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S«»me 1.500 fairg-.>ers said they wanted more information about RFD after this display booth introduced 
them to the project. The information booth was set up at -county fairs in all four counties. 
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Phase Two; From Show Date Minus One Month to Show Date Minus 
One Week. 

* Bond out mailings in industry onvelopos. 

* Begin on-air promos. 

* Begin local radio spots. 

* Staff appearances on TV interview shows, deejay programs 

* Plug for newspaper features on project, 

* Column items released and plugged. 

* Individual captioned pictures serviced to local papers 
and wire services. 

* Put help from local industry into story form and release 
it to the press. 

Phase Three ; Show Date Minus One Week through First Month of 
Show. 

* Begin local paid TV spots. 

* Intensify radio spot campaign. 

* Begin newspaper ads in TV section. 

* Hold press conference for local papers. 

* Announce contests. 
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IIT GhMk wliit vou «Mmt. RPO liM Hh« «C M C0tt 



■ TV "ftWtir Oft yoMf mm. your n tii ^ of i , 

■ SpodatartidttofthouiilioldbudiH^in^^ 
ffomodtlinQ^ chHdroRa fifmifif "* lAd hundfodi inofo* 

■ iMytouttinfonnMlonloinmMyourfitd^ 
fi9urift9*itli. 

■ UitfulinfomitiOfiiOMMyoiiifimytfollm^to^ 

■ FortimMdmMioitiiiiiltt»«itfo«tfc^ 

thi IMiioft MO or4W aO»3mili«alt ffit M)^ HMOUIMI 



«8 



VNCVtHSIfV tXttMMM ttUVI 



ERIC 



RFl)*s prtmuitumal brochure was used to recruit participants, 

55 



BEST con AVAIIME 



SI 




Hiim 4ni Mtmm fm AA»k% of Stwufcrin Ikm^Hin 



RFD More TImii 
Teievisioti Series 

fmOmi by thr VS Omc^y eC NnciHt>, KfP 
liMcM^MiptniUIr tor atfuttt hvMKtii Wto> 
OMilM'a ftMit. Orttfi. km and Ul«y«tlt 



8t» Iht bond article on thtn pajcr for o^ 
•el Mrnai ao d day of the HTD TV ihow*. 

JITD la pMtetd ^ WHA-TV. ChawMrt ai. 
tW alwwt art ta^cd ill the WHA-TV aiHdlM 
InlfadiMmWiMMlit 

TV Aowe win be 4uiili.faced and 
•Htftitaing*'* Mid Ber^ flraah. Freiaet Di* 
rwior and tMcmtve P»«ducer. 

"Dim win bt aa awtny ae a deuM differ^ 
Ml«lHrtfeaUima»aadiKrOtfMw. teh 
ibov wtU fkva aduHa trbal they want tnm 
tV^-ioad entmMMMfii aad piaetieal lalov* 
matM they Moae UMMdiately.'' he taid. 

tm addtueo to TV» RTD ia dfirrmf apertai 
biiUetuu wrtttni far adtiito wtih 1ms than a 
htfhaehoelediicatioA. HimdNds ol buUettns 
dre available aha4t a wide rai>|e of teptesi 



ieethearMee* 



ZUt m Usuac el 



KfD alK provides thrto^rtng binders tn 
which the RFD buQeUns can be kept AH the 
maiertals aStced by RFD are fffe to adulta 
of southern WiscoMia 

The KTD TV shews and the RFD buUctlns 
lei h p te wf n t eerh other. Many of the rfiort 
featufts on the TV ihows are bsacd on infor* 
matlon from the JIFD butletins In fact, the 
prtmary purpeae of the TV show ts to explain 
the vsrKHis t>sies of information ovaiUble m 
the RFD bulletins. 

*'Wlth the RFD bulletins. «i adult can 
pick up the information he ne e ds and do tt 
an tn hie own honw.** said Aanoate Director 
Stephen Udvan. who heads a team el writers 
prepanng the RFD bulletins. 

RFD If the Urst Adult Basic Education pro- 
i«ct ci Its kind in the Untied States St is 
betiMI tested in Wisconsin lor possible use na* 
tionstly 



FIRSTSHOWJAN.4 

The first Rrr> TV »h«iw ts sched. 
ul»fl fi*f %t<ioii4V. J4nusry 4. 1971. 
Tf^fi* util 30 3&'minute RFD 
TV «iio«i4 Thcff will br a new 
►r...w pMii wrek. on ChsnnH 31. 

fU%'h M'U ahftw will h» ibown on 
itiur HtfTfrmt tiav» At Umf mffrrent 
Un tr% jny »w can tev the 

%t, »w rft A rt*nv*«if*nt timr A nrw 
lin> T\' kt,»tA Wilt b«'»tin cwry 

\\* t*' ..r< tK|. i,m*>* ami djvs ths 
HVit «*.trt*» 4.»n u- ••■•11 on Chan* 
nri :l 

• MoAdjy at $ 30 am 

• Af(t'M»sfl4/ at 7 pm 

• Thu*%dey 01 3 30 pm 

• Sunday at 4 30 pm 




TlMne Wtit be ai weekly teievMon shows 
BiganlM hi January Kach show ia 10 
MI.IIIM loti and wdl be 4ired •ver Obmne: 
21. There wtD be a new ihow i^h week, and 
eaeh ahow wdl be aired at different Umea on 
teir diilsfent days. 



A pepnlif mdio ad IV sear . /*m Mader w« be im on a«inrt a. 

jm MADER HOST OF RFD 



When thia man% faahtan* vake sawMto out 
ovvr radio* people like it-and they Usttn. 
And when people tune to Channel % from 
Uadlson to see the neies. sports and wrathfT. 
they look for this man. His gray-strv^ked 
hair, honest tone of voice and quick smile are 
known to thousands uf radio nnd TV faira all 
over southern Wisconstn 

When a talent hunt wu% ri>fiiiuct«^ to rm*l 
a suitable host far RFD. thv ar«rch ttitftcHl 
and stopped with thia man. Jim Mader. 

Mad»>r is the hM or guy whodetidhta tn 
llvtnit. He en)eya himself. He enioys otheta 
IHmple nauirally turn to him whn m talks 
and jokes. He haa food laafcsi Hehaatatent 

But when RFD %vent smrchin« Ibr s taU 
ented host, they wanted more than "pood 
looks, a smile and a shoushine** The host oC 
RFD had to knew and tindtnimd rural 



adults. Jim Uadenii that kitid el guy 
For the 4t«ysnfold native of Win. 
rural adulu and their wny of life am 
than a passtag tntefvst For Jim 
"Rural America is sull the answer \ 
of the problems factnn tho nation." 

J»m» H<«ik Is rsdHj «nd trtev*«len. He 

iffa>% tm«!.r t.( hi« work m the city of Mndtum 
I»mI. Iik4.^ (•• I Aw<i> irttm the city and 
Its hvitu: ^tMe> 

He ^nd hia wlff^ ^kvtni Rmm ate aMMm 
*^ldBar noClviilaa Rke hiaiku and dMMM 
invnhm thn enttpt tanlly * hp «gr& "Ittm 
pramrvatiae and ssnssmrian al wild landi 
have bsMsne aa tSMastma im. ite 



have baconm m tm p si t a n l le la^ ttel 

Maderi are at home far anty r 

ends during the ynnr. 

f Coartnued paft 1> 



mtfnt 
ihould 



Johnny Cash, Arthur 
Others, Star on RFD 

llajor names in the entertainment world 
WtU be on the RFD TV diows. These big- 
name stars have donated thetf time to be on 
the RFD weekly adult television amet. Kach 
RFD show wilt have at least two entertahi* 
ment segments featuring one of these stars. 

Some of the stsfs are Johnny Cash. Buddy 
Ebsm. Arthur Godffvy. Fred MactCurray, 
Eva Osbor. XukU Fran and Ohe. and Red 
Skelton Popular groupa and cntertalntta 
from suuthrm Wtstonstn also wdl make gusil 
appt^nces on the RFD shows. 

"TKrtc celebrities will do more than juat 
thrtr act** explained Boris Firank, tajaet Ol- 
rvctor 

"For tnsunee. Johnny Cash ilntfi and 
pUys hi> trutur. but he also talks with ua 
sbout the books he reads and how he feels 
abcmt current events, snd other thlni^ that 
m.ikc ht« n p pw anee on the RFD shows more 
int^frsting ** 

Rs^'h RFD show ts made up of several 
•hort features There will be features abeul 
pruducmg bk/tter h^tgs. cooktng tasty and in- 
•«prn4t\e meals, and makmg sharteuts that 
ta«'e money But there alio will be just pur* 
vnt^rtaiitmeni 

"As we plan it new. thsre wlO be two se^ 
menu of cech RFD show devoted Just to fton«** 
ssKi Frsnk. 



Godfrey, 
TV Shows 

we are to have an anisftainlng TV 
we mutt have jnsi that antanrti 
And With these stais. RFD t 
be entertanung,** he said. 




CM teiU 6e sren on RFD TV. 



The RFD Almanac became the project's newspaper, capitalizing on that medium's popularity. 
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The Promotional Brochure 



In addition to using the press, radio, television and 
othcrmothods to promote participation, RFD used J promo- 
tional brochure. The brochure wks a oie-color 8 1/2 by U 

1^1^^ ^5^^ outlined essential details of the project, 
^ i«c?Li;S*u®' ^? ^^^^^ participation, provided 

ultl^ 11^ ''^^^^ individual could i^dicat^ interest, 
ii ""^^ number to call for more information, and used 
Illustrations meaningful to the target population. 

t^TaJ^LlJ^^^^''^ distributed widely to members of the 

Da^t^ci5a^^,^^«n5^^^^^'^^'^^ ^^""? the project to recruil 
participants and to reinforce participation. 

crtHtlin/S?® visitors distributed the brochure during re- 
^n^t!? ^ °? participants. It was mailed to persons on 

I? seivfcrMnh^^fJ?7 f^^ P*"^<^ at meetings 

«hif ly and community organizations. It was avail- 

and a? nnMfr"^^ of supermarkets and discount stores, 

w«ff«L^^^i- ''''^t^ ^l^^^ ^^""^^^ employment offices, 
welfare offices, churches and community centers. 

to disJribStS^"^ °^ advisory group were given copies 

The Almanac 

^*»c4«I^5 Almanac was a monthly tabloid for participants 
-f^? motivate participation in RFD, disseminate prac - 
wL advertise RFD»s services and materials, 

cioafina ?i dpS° everyone who expressed an interest in par • 
fir,Sa?!.4oiF°' to persons who called or wrote Action Li, 
-^f information, to adults suggested by count 
service agencies, and thole enlisted at ' 
issCe^wL^'Sf^t. f J^'^'^'^u^ circulation of 3,300. The first 

'"^'^^^ the TV series began. 

Smpaign? ' '^'''^'^ ^ integral part of the promotional 

four-page issue contained articles about RFD's 
hnm! c?n5S shows and personalities, about Action Line and the 
tw llnt^ ""^^r^?^?* °' display advertisements 

Innl.lnlTl'^t^ ^^"u^^^ ^° sorvicos. ^Tho Almanac 

contained hints on how to do things, answers to selected 

«rfli??.o^"® questions, and articles presenting factual and 
practical information. 
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The Almanac was written at a fourth to sixth grade cquiv* 
alency level of comprehension, the independent study level, 
using no more than 15 syllables per sentence. 

An Almanac had particular relevance to the rural audience 
of the initial test, but other forms may be pertinent for 
other populations. 

While RFD distributed the Almanac monthly, consideration 
should be given to weekly or bi-weekly issues if budget allows 
Greater frequency would tie in more closely with radio and TV 
and might reduce the need for extensive printed bulletin sup- 
plements. 



PROFESSIONAL NEWSLETTER 

Professionals in education, health and social services 
are constantly seeking new ways to enrich their programs 
which is sufficient reason for innovative educational programs 
to share their information and experiences with others in the 
field. 

RFD communicated with other professionals by means of a 
monthly four-page newsletter. The RFD Newsletter was sent 
to over 3,000 professional educators, social workers and 
others to inform them of the project *s progress, innovations, 
evaluation, and problems. Each issue focused on a major issue 
or aspect of the project. Collectively, they form the project 
chronicle. 
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THE RFD SYSTEM 

TELEVISION AND RADIO 
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TULEVISION 



Like other delivery components in this mediated system, 
TV presented practical, directly applicable, down-to-earth 
factual information on health, nutrition, first aid, child 
development, safety, sanitation, interpersonal relations and 
other adult interest areas established by the card sort. 

In addition to interests of the target audience, TV shows 
had to reflect the racial, ethnic and political characteristics 
of the general TV audience and appeal to the general audience 
to avoid stigmatizing the "disadvantaged" or "undereducated" 
adult. Demographic characteristics were determined through a 
telephone survey that revealed the general audience was pri- 
marily white. Catholic or Lutheran, of German or Scandinavian 
background, and politically conservative. 

Format for the TV shows was determined through a telephone 
survey of media habits and preferences, which corroborated 
three independent studies showing that low income - low educa- 
tion adults prefer fast-paced news and public affairs shows. 

RFD developed a similar quick -paced magazine format. Each 
show contained 15-20 different segments, some very brief, 
others three or four minutes long, held together by a congenial 
anchorman and host. Each segment focused on one major concept 
and presented it as clearly, concisely and directly as possible, 
with the TV staff guided by the axiom "tell them what you're 
going to tell them, tell them, and then tell them what you told 
them." 

The sltows were 30 minutes long and shown four different 
times each week: Monday 8:30 a.m., Wednesday 7:00 p.m., 
Thursday 3:30 p.m., and Sunday 4:30 p.m. Air times were sel- 
ected on the basis of audience preference studies. 

The TV programs were informational but avoided "instruc- 
tional" TV show format and content: there was no blackboard, 
teacher and pedagogical hard-sell. Instead, the TV programs 
combined entertainment with useful information of inmiediate 
value. TV showed viewers simple and direct ways they could 
improve their lives and told them of agencies to contact and 
places to go to solve problems or pursue interests. Thus 
television helped viewers build strategies for continued ac- 
quisition of information. The system used television to 
motivate viewers to participate in the project and to intro- 
duce concepts presented in RFD's home study materials. Each 
show included brief announcements of one or two RFD bulletins, 
as well as announcements of Action Line (RFD's telephone ser- 
vice) for ordering bulletins and obtaining answers to questions 
of any nature. 
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Johnny Cash was one of the big-name stars appearing on the RFD television shows. 
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TV host Jim Mader (seated) and TV director Bob Leu on the main TV set-a homey country kitchen. 
Mader received many letters during the series* several of which commented on the clash between these 
striped curtains and the flowery wallpaper. The curtains were replaced by plain blue ones in a TV seg- 
ment showing how to measure windows for curt *ns and drapes. 



65 



BEST COPY AVAILABLE 




BEST COPY AVAiLABU 



62 




63- 



TV writers used subjects researched for the home study 
bulletins as the source of TV content. The staff videotaped 
or filmed segments throughout the target area, including 
homes, backyards, stores, offices, shops and parking lots. 
Tho base of operations for the TV show was a roomy, functional 
and comlortablc country kitchen set that doubled as a cooking- 
demonstration set for a home economist. 

During the field test in southern Wisconsin, TV shows 
were geared to the rural nature of the target audience, but 
the flexibility of the RFD system permits TV and other compon- 
ents to reflect the characteristics and interests of any 
audience. 

The Wisconsin shows included interviews with stars 
Johnny Cash, Buddy Ebi;en, Burl Ives, Eddie Albert and others, 
who often talked about their own rural backgrounds and pre- 
sented their views on country living, conservation, pollution 
and a variety of subjects. Local segments included brief 
histories of places of interest, interviews with a conserva- 
tionist and other people of interest, and music by a country- 
western group.* There were segments on emergency first aid; 
a typical day in the life of a visiting nurse; concepts of 
child development and communication in marriage; recipes; 
cooking demonstrations; shopping tips; exercises; beauty tips; 
interviews with state and local authorities on insurance, 
septic tank regulations, hogs, auctions, used cars, legal 
rights and other practical concerns; and a hand puppet whose 
"goofs" as husband and consumer were meant to be amusing and 
instructive. 

An importart and highly successful part of each RFD show 
was the special segment entitled "RFD Hints." These were 
snappy ideas on practical ways to improve the viewer's immedi- 
ate life situation directly and easily. They included items 
such as hov/ to reseal a refrigerator door, remove spots, pound 
small nails safely, kill insects around garbage cans, and 
remove odors from plastic containers. The show solicited 
hints from the audience through a contest. The better hints 
were videotaped and presented on TV along with the name of the 
contributor who won a small prize. 

Early in the project the TV show announced a recipe con- 
test that generated favorite recipes from hundreds of viewers. 
A home economist selected 65 prize-winning recipes (based on 
simplicity and economy) for incorporation into RFD's Favorite 
Recipe Book, which was made available to anyone requesting a 
copy. The five top winners were announced on T\ All winners 
received an RFD coffee mug. 



* The staff learned that it should have used more local maps 
to orient viewers , many of whom did not recognize local place 
names within their own and neighboring counties. 
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FVngram 16's rundown sheet: Burl Ives, budgeting, pollution, shopping tips, beauty hint, exercises, 
ttnmtoos. and citizenship. 
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K« « are just two of the ways in which the audience may 

be made participants and contributors to the TV program and 
gain personal recognition in the process, ana 

TV staff for the'20-show field test included a producer 
production assistant, cinematographer, two writers, the TV * 
host, and an executive producer/director who supervised the 
entire operation. 

K,.^ 4^? »ot the first adult education project to use TV, 
^ br«J/L2?? to adapt TV forSat'and content to 

Llllltil ^T^ ?f -^"^^^ "^.^^t targeting on a specific sub- 
rSni?? «2;4 ^'^^^^^ " coordinate TV into 

a multi-media and personal delivery system. More adults use 

Haa I ^H^V^^l^^^ entertainment today than any other 

s stem* increases its value to a mediated delivery 

Major elements in planning the TV component are: 

* Target audience 

What are its abilities, interests, needs, media habits 
and preferences, and general characteristics. 

* Format 

Wiat format is most suitable to the information and to 
the target audience: the hosted show, magazine, news 
and variety show with short segments, interviews, 
entertainment, music, etc. What combination of elements 
IS most suitable. What sets should be used. 

* Content 

What content is best able to meet project goals and 
audience needs and interests, and motivate the target 
population. The choice includes hints, short documen- 
taries on local scenes and people, factual information 
and facts about social agencies and other community 
resources, local and big-name talents, etc. 



Staff 



What are the staff requirements to produce the shows, 
direct them, write material, edit tapes, host shows. 



etc. 

Coordination 



TV component with the other 
delivery components of the project: Action Line, Almanac, 
home study and paraprofessional home visits. 
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* Pretest of pilot TV programs 

* Two-way flow 

Promote and reinforce audience participation through 
contests, letters, quest ion -answering, etc. 

* Production 

Establish a feasible production schedule for TV shows. 

* Outside resources 

Use available outside resources for TV shows such as 
interviews, films and announcements of public service 
agencies, on welfare, employment, legal aid, education 
conservation, consumerism, safety, health, etc. 



RADIO 



In addition to using paid and public service announcements 
to promote RFD, the project produced a public service radio 
program to motivate and reinforce participation. The RFD staff 
contacted local radio stations to determine the length of pub- 
lic service announcements they could use, arriving at an average 
of three and a half minutes. *^ 

The "RFD Radio Almanac" programs were bright and quick. 
In a typical spot, the RFD television host and another announc- 
er opened with an introduction, presented a quick household 
hint, a 50 -word feature based on printed materials, another 
hint, a recipe, another short feature on printed materials, 
another hint, and a humorous close. Each spot referred to the 
RFD television show and Action Line telephone number. 

Scripts for radio spots were coordinated with television 
and print material staffs and were designed to integrate with 
other RFD elements while standing alone. The spots used the 

soft sell" of public service announcements and avoided "push- 
ing the television programs or print materials. 
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ACTION LINE 



The RFD system was designed to be as responsive to the 
needs of its adult participants as possible. Its television 
programs and home study materials could meet their life coping 
needs and interests but could not respond to their more per- 
sonal or immediate needs. RFD used home visitors and developed 
Action Line to ensure total system responsiveness and to help 
adults who do not know where to turn for help or information. 

Action Line was one of several elements permitting parti- 
cipants to interact with the project and thus provide feedback 
to the staff. Technically, during RFD *s implementation, the 
mails were part of Action Line, but for simplicity's sake this 
summary refers only to Action Line as a telephone service -- 
its staffing, operation, referral procedures, and coordination 
with outside agencies. Other feedback elements of this media- 
ted system were the home visitor and the mails. 

To implement the Action Line system, the project used two 
inbound and one outbound telephone lines. One inbound line 
covered the local metropolitan area and the other, a toll-free 
WATS line, covered the rural areas. Both inbound lines were 
equipped with tape recorders for callers to use after office 
hours and on weekends. 

During the day Action Line was staffed by two volunteers 
of the Oiurch Women United (the project has been endorsed by 
the national office of that organization) . RFD used 20 volun- 
teers each week- -two in the morning and two in the afternoon. 
Two volunteers coordinated staffing assignments, supervised 
and trained the staff and helped solve procedural problems. 

Action Line's response depended on the nature of the call. 
Requests for informational bulle*^ins and questions that could 
be answered by bulletins were referred to the RFD home study 
teacher. If the question was simple and answerable in brief, 
factual form (what time does the school bus leave) , information 
was secured from a community source and immediately relayed to 
the caller. If the question was more complex or personal 
(how can I adopt a child) , the Action Line staff contacted the 
appropriate community agency, gave it the name, phone number 
and address of the caller and a precise summary of the request, 
and asked the agency to contact the caller. After an author- 
ized agency person such as an intake worker had acknowledged 
the agency's willingness to accept the referral. Action Line 
immediately notified the caller that the problem had been re- 
ferred to another agency and that he would be contacted by that 
agency. RFD also sent a written confirmation of each referral 
to the caller and to the agency on the day of the call, to 
remind the agency and reassure the caller. 
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Action Line's referral method must be coordinated with 
service agencies, which otherwise might see it as a device 
that could overload caseworkers and disrupt existing relation- 
ships with clients. To meet this possible objection and to 
create mutual cooperation and understanding, the RFD staff 
met with agency staff members early in the planning stage to 
discuss the project and its goals and to develop procedures 
for referrals. They also met periodically during implemen- 
tation to evaluate procedures. During these contacts, the RFD 
staff assumed the responsibility for demonstrating its desire 
to work closely with all community agencies to achieve agency 
objectives as well as objectives of adult continuing education. 
These contacts also helped RFD understand agency methods, prob- 
lems, and capabilities. 

During implementation RFD developed operating procedures 
that might be useful to other projects. It compiled (1) an 
index of some 30 major problem areas and subcategories (see 
list at end of this section) and (2) a directory of community 
agencies with the appropriate agency listed under specific 
problem categories, a system that enabled the volunteer to 
locate the agency rapidly and easily. A hanging card file was 
easy to use and facilitated indexing. 

Action Line received 1,641 calls and mail responses during 
the RFD project. The majority (85 percent) were requests for 
home study materials or were questions simple enough for volun- 
teers to research and answer directly. The other 240 questions 
were too complex, technical, or personal for volunteers to 
answer, and were referred to appropriate governmental, social, 
commercial, religious, and educational agencies and institutions 
which replied directly to the questioner. 

A follow-up questionnaire on the effectiveness of referral 
revealed a high degree of client and agency satisfaction. 
Sixty-six percent of the clients and of the agencies returned 
the questionnaires; of the clients, 89 percent said they were 
satisfied with agency services. Of the referral agencies, 92 
iiercent said RFD had stated the problem correctly and 84 per- 
cent reported that they were able to provide the requested 
service. 

Categories of greatest concern to Action Line users were 
foods (63 queries), home maintenance (54), consumer problems 
(52), family finance (50), gardening (34), health services 
(25), home crafts (21), employment (20), legal assistance (19), 
and entertainment and recreation (18). 
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These forms permitted Action Line volunteers to respond to each call rapidly. 
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ADOPTION SERVICES 



EMPLOYMENT 



Private agencies 
Public agencies 

ANTIQUES 

Appraisals 

Dealers (buy and sell) 

AUTOMOBILES 

Accident claims 
Licenses and titles 
Performance 

COMMUNITY ORGANIZATIONS 

Agricultural 
Churches 

Drug information 
Handicapped persons 
Legal services 
Minorities (racial and 
ethnic) 

Pollution control 
Volunteer service 

CONSUMER PROBLEMS 

Advertising practices 
Contracts 
Insurance claims 
Product safety- 
Public utilities 
Sal«s schemes 
Unsatisfactory services 
and products 

EDUCATION 

Accreditation 
Adult education 
Apprenticeships 
Parochial schools (elemen- 
tary, secondary) 
Public schools (elementary, 
secondary) 
Special education 
Student financial aid 
Vocational training 



Apprenticeships 

Help wanted 

Job wanted (adult) 

Job wanted (youth) 

Small business loans 

Wages 

Workman's compensation 
Workers' protection 

ENTERTAINMENT AND RECREATION 

Crafts 

Games 

Museums 

Music (recorded) 
Outdoor recreation 
Television and radio 
Tickets (concerts, theater, 
sports) 

Travel (automobile) 
USO 

FAMILY FINANCE 

Assistance, family 
Assistance, handicapped 
Family budgeting 
Financial aid for student 
Food stamps 
Health insurance 
Home ownership 
Interest rates 
Life insurance 
Medicare 

Savings and investments 
Social Security 
Taxes, federal 
Taxes, local 
Taxes, state 
Unemployment insurance 

FARMING 

Farm loans 
Fruit trees 
Livestock diseases 
Milk advertising 
Shade trees 
Weed control 
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HOMR APPLIANCES 



Contaminated foods 
Diets, low fat 
Diets, special health 
problems 

Diets, weight reducing 

Pood adulterant 

Food preserving 

Food purchases 

Menu planning 

Nutrition 

Recipes 

Surplus commodities use 
GARDENING 

Fertilizer, chemical 

Fertilizer, organic 

Flowers 

House plants 

Insect control 

Lawn care 

Shrubs 

Soil care 

Trees 

Vegetables 
Weed control 

HEALTH SERVICES 

Alcoholism 
Allergies 
Arthritis 
Blood bank 
Diets 

Drug abuse 
Heart diseases 
Infant care 

Mental health problems 
Skin diseases 
Toxic chemicals 
Water testing 

HISTORICAL INFORMATION 

Local history 
State history 
World history 



Instruction for use 
Parts and service 

HOME CRAFTS 

Home repair information 
Home repair materials 
Craft skill information 
Craft materials 

HOME DECORATION 

Carpeting 
Color schemes 
Fumishinss 
Upholstering 

HOME MAINTENANCE 

Care of clothing 
Cleaning 

Home repairs (materials) 
Home repairs (services) 
Home repairs (skills) 
Tools for home maintenance 

HOME MANAGEMENT 

Home building plans 
Home safety 
Room design 
Utilities 

HOME RENTING 

Contracts and leases 
Securing rental housing 
Tenant -landlord problems 

LEGAL ASSISTANCE 

Contests, lotteries and 
redeeming coupons 
Contracts 
Interest rates 
Liability 

Neighborhood nuisances 

Passports 

Wills and probate 
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PERSONAL ADJUSTMENT 

Alcoholism 
Counseling services. 
Divorce problems 
Family relationships 
Friendships 

PEST CONTROL 

Insect control 
Rodent control 

POLITICAL INFORMATION 

Congress 
Legislators 
Municipal government 
Political participation 
Voter registration 

POSTAL SERVICE 

Bulk mail problems 
Mail delivery 



STREETS AND HIGHWAYS 
Property lines 

Repair of streets and highways 
Right of way maintenance 
Traffic control 

TRANSPORTATION 

Airline schedules 
Bus schedules 
School buses 

WASTE DISPOSAL 

Chemical and solvent disposal 
Disposal sites 
Recycling w^:<tes 

WILDLIFE 

Conservation and control practices 
Hunting and trapping regulations 
Song birds 
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RECOMMENDATIONS 

The following reconunendations can be made based on the 
Wisconsin field test: 

* Keep proper work of Action Line workers and supervisors 
to an absolute minimum. Use snap-apart forms. Write in long- 
hand - avoid typing. If evaluation data are desired, they 
should be gathered by sampling. 

* Confer with agency administrators and staff to assess 
the information and service each agency is best able to provide. 
Use this information to build the index. Check the validity of 
these judgments through the experiences of Action Line workers. 

* Train workers to listen attentively to everything the 
caller says; to detect the caller's unstated needs and encour- 
age their articulation; to restate the problem or question 
accurately to the agency; never to guess what the real problem 
is; to ascertain if the caller objects to having a highly per- 
sonal and sensitive problem referred to another agency; and to 
respect all confidences. 

* Seek and use the assistance of specialized sources of 
direct help for drug abuse cases. 

* Keep all community agencies informed about the progress 
of Action Line during implementation. 

* Make sure a responsible agency representative indicates 
an agency's willingness to accept referrals. It is important 
that the first agency to contact the caller be the one best 
equipped to handle the problem. 

* Use all available media to promote wide public use of 
Action Line. 

* Each Action Line s -af f member should have both an in- 
bound and an outbound telephone line so that each call can be 
handled without delay. 
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DEVELOPMENT OF THE HOME STUDY COMPONENT 



The home study component of this mediated system gives 
the adult total control over his own learning. The adult 
can diagnose his own learning needs and choose specific print 
materials to meet those needs. He is free to learn when and 
where he chooses without being forced to follow a sequence of 
topics or being exposed to grades, quizzes or other childish 
pedagogy. In short, this component incorporates the essential 
principles of adult learning discussed in the first part of 
this series. In addition, the adult is not forced to upgrade 
his reading skills in a traditional progression from grade to 
grade found in public schools. He can continue to learn about 
a variety of topics at his own success level. He can also 
choose to improve his reading skills and computational skills 
if he wants, and move vertically as well as horizontally. 
Here, too, the adult determines his own needs. Participants 
are not told the way to do something. Rather, they are given 
alternatives. It is up to them to select the alternative 
best suited to their needs. 

Like other components of the mediated system, the print 
component is shaped to reflect the wants, interests and needs 
of the target population. This shaping involves form as well 
as content, since the disadvantaged adult is sensitive to 
implications of shoddy or childish print materials. Content 
is determined by going directly to the target population. 

During the development of RFD, the staff used a card 
sort to systematically determine the priority of interests, 
wants and needs of the target population- -undereducated and 
disadvantaged adults in southern Wisconsin. This information 
guided development of the print component as well as television 
radio, and the Almanac. The card sort revealed that adults 
are primarily interested in learning how to solve problems of 
everyday life. They want practical information that has im- 
mediate application to their lives such as how to cook inex- 
pensive and nutritious meals, buy insurance, understand con- 
tracts, make a will, find a job, get aloug with others, and 
many other topics that constitute a life coping skill curricu- 
lum. The specific needs vary from adult to adult and from 
region to region, but it is generally true that adults want 
to learn information that they can use --information that is 
relevant to their own lives, strategies that can positively 
affect their lives. 

Since this mediated system permits the adult to receive 
exactly what he wants to learn- -no more and no less --the print 
component is best made available as brief, single-concept bul- 
letins. Television, home visitors, radio programs and the 
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Sample of an RFD home-study unit written at the fourth to sixth grade equivalency level. 
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Almanac inform adults of the availability of those materials 
and the adult may order any bulletin ho wants by mail, Action 
Line telephone or home visitor. Pre-stamped post cards in 
home study bulletins made it convenient for the adult to order 
additional materials. Home study materials also contained 
"write -a-note" cards to encourage comments and questions on 
any subject at all. 

During the RFD field test, materials were distributed on 
a unit basis of approximately five bulletins each. Single 
bulletins were not sent separately because it was felt that 
there was sufficient internal cohesiveness within the units 
to permit the 20 -week Wisconsin field test to operate at the 
unit level. Other projects may wish to distribute materials 
on the single bulletin basis. 

The bulletins must be as "adult" in content and appear- 
ance as possible and be written at a level that is easily 
understood by the target population. In the case of RFD, 
this was the fourth to sixth grade reading equivalency level, 
tht' level that permits adults to read without assistance 
(12-14 syllables per sentence). 

The staff organized the wants, interests and needs of 
the target population into four "content centers" as indicated 
on the following page. These were About Me, About Me and 
Others, About Me and My Money, and About Me and My Community. 
Each content center was further divided into modules and units. 
Each unit contained several bulletins on specific topics. In 
all there were some 320 different bulletins available to adults 
during the RFD demonstration. 

In order to develop the print component the staff reviewed 
existing instructional materials for adults to determine if 
they were understandable, believable and useful to the target 
population.* Most existing materials were found to be inad- 
equate or inappropriate. Most stressed reading and writing 
skill development, were written at the seventh to eighth grade 
level, and were liirtt^d to areas of money management and em- 
ployment. There was little in areas of child development, home 
maintenance and repair, consumership, citizenship, and other 
areas of adult concern. Existing materials were used where 
they met RFD standards for understandability, believability and 
usefulness. The rest were developed as new material by the 
RFD staff. ' 



* An annotated bibliography of learning materials for adults, 
prepared during RFD's evaluation of existing materials, is avail 
able upon request. It evaluates materials for teaching adult com 
munication, computation, and life-coping skills in terms of four 
levels of readability--introductory to advanced. Each citation 
describes the publication's subject matter and assesses its for- 
mat, structure, sequence, population orientation, and suggested 
use. Readers may obtain a copy by writing RFD, WHA-TV, Univer- 
sity of Wisconsin - Extension, Madison, WI 53706. 
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Wlwt AffMt* Mm HMdity and EnvirafMnMit 
MhM I BttiMt: OowMopingClMraetar 

IMV WELL BEINQ 

My Phydeai HMlth 

My Mtnttf HMth 

IMy Education 

IMy Lai«ir« and Racnatioii 

Maturinf and Qrowrini Old Qraaaf ully 

SECOMINQ A BETTEN PERSON 
t Am Chanfing: How Chanii Affaeta M* 
I Am a ParMn: OirMty. tnttfrity 
Metivatien: 8alf*Diraction 
I Can M*a Thinga Oianga 



MMuiaAt 

UnHli 
UnHBt 
UMtS: 
UnH4i 
UnH St 



UnH It 
UnHSt 
UnH St 
UnH4i 



UnH It 
UnHSt 
UnHS: 
UnH 4: 



HOW TO LOOK PdR A JOB 
Sewwiof Jaba 
Laiiaitand Povm 



impOftiRtJob Paeti 
Summtry fpr Job Hunmn 

MOW TO AFPUY fOH THAT JOft 



HOW TO GET THE MOST PNOM MV JOI 
My RtipofiiMiltiii tethtJob 
My •oM'i Wtipo nUb mHw to kto 
Qmkm AhMd on tho Job 
Lmm Arotiottiii Workofi 



IV CONTENT CENTER: ME AND MY COMMUNITY 



11 CONTENT CENTER: ABOUT ME AND OTHERS 



MY FAMILY 

UMt 1: Homo is for Family Living 

IMt 2^ Qttting AtOAO with Om'$ Marriioi Fbrtmr 

UMI 3: Undorttifitf!^ Fooflfip of Fvnily Mrnibtn 

IMt 4: Qvidini ChMm mi iuMino Cliifonir 

IMti: Family r ^JTimoa 

MaMa ■: COMMH ' CATINO WITH OTHERS 

IMti: MyFriaooa 

Unit 2: My Naighbors 

UnH S: Tha Art of LIstanlfii 

Unit 4; Ratpaetini Othar ^aopla'a l4aoa and Saliafl 

Mtiatt C: WORKING WITH OTHER FEOFLE 

Unitl: PaopialOaalvvHhfbfSafvitaa 

Unit 2: Faopla I WoHc with on thatlob 

• •-f^. oswwito I Work f or 
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At ME AND THE PEOPLE 

UnHI: OfT)iaPaopla.ByTh*Paopla.ForTliaPaepla 

\Mt 2: Tha Oaeiaration of Indapindanca 

UnHSt Our Centtitution and What HMaana 

UhH4: HewWaOrpniMiedeBuainaHinAmariea 

INodMl* B: MY QOVERNMENT, HOW IT WORKS 

UnH 1 : In My Community 

UnH 2: inMyStata 

UnHS: in My Country 

UnH 4: In lha World 

Modnla Cl CITIZENSHIP IS TAKING PART IN OCCISIONS 

UMtl: Myrig^taaaaCHitan 

UnHSt MyRa^ModbUHiaiMaCitiaan 

UnH 3: Bainf an InfomMd Citixan 

UnH 4t Population! Polkitlonl ConMfvaiioni 

Modula Dt WKE RE TO 00. WHO TO CSE, WHAT TO 00 

UnH 1 : Walfara and Employmant SMvicat 

UnH 2: Madieal and Haaith Sarvieaa 

UnHS: Lagai Aid Sarvieaa 

UnH4: Laiaura and Racraaiional Sacvicaa 
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The new materials were written in clear journalistic 
style, the form to which most adults are accustomed and one 
which is geared to easy readability. The writers used sen- 
tences which contained one main idea expressed briefly and 
concisely in familiar but simple words. Abstract ideas were 
conveyed by means of concrete or human examples. To heighten 
readability writers made liberal use of personal pronouns and 
personal references. They tried to personalize the content 
and show how it could affect the reader in his own life. This 
was sometimes done with stories. 

The printed bulletins comprised a life coping skill cur- 
riculum, but the print component was flexible enough to deliver 
other information as well. Materials also were available in 
more traditional areas of adult learning such as reading, spell- 
ing, writing and arithmetic. These materials were made avail- 
able to home visitor clients during the RPD field test if the 
clients expressed a need or interest to learn more in these 
areas. 

Projects using home visitors should provi 'e the visitors 
with a wide selection of back up materials. These materials 
should be broad enough to meet the special learning needs of 
clients in every content area in terms of ability level, detail 
and, when necessary, role. If the client wants to learn how 
to read, spell, or multiply using a structured format, or wants 
to read adult literature, the home visitor should be able to 
draw on this resource bank and select the materials most ap- 
propriate to his interests and abilities. If the client ex- 
presses an interest in learning more about being a wife, hus- 
band, parent, homemaker, or employee, appropriate role-related 
materials should be available. 

oc.^ ^ °^ three-ring binders was designed to hold the 

RI-D materials. The binders contained pocket inserts to hold the 
adult's own clippings, recipes, brochures and pamphlets, enabling 
the adult to add his own materials to those of the project. The 
loose-leaf binder and individual bulletin system has advantages 
over traditional hard-cover texts because it permits the adult 
to assemble his own materials and enables a project to localize 
materials and speak to particular ethnic and language needs. 

During the 20 -week Wisconsin field test, RFD distributed 
10,454 units averaging five bulletins each and 920 supplementary 
bulletins to 1,714 adults. In addition, it sent out 167 sets 
of binders complete with index dividers, unit introductions and 
post card order forms. 

It is important to allow adequate lead time to prepare materials. 
One year from concept to final printing is not unreasonable. 
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HOME STUDY TEACHER 

Adults may need help in articulating their needs for 
basic educational and life coping skill information. This is 
one of the primary functions of the paraprofessional home 
visitor as explained in the sixth part of this series. A 
home study teacher, using the telephone and the mails, can 
also perform this function for many participants. To be help- 
ful to participants, the home study teacher will want to learn 
as much as possible about each one. Information gained from 
letters and phone calls should be collected in a separate file 
for each participant. The use of tests to determine prior 
achievement is discouraged because tests are often perceived 
as threatening, especially by the primary target audience for 
KFD. Much can be learned about individuals through open and 
frequent communication. Needs for language skill development, 
family life information, or community participation will be 
revealed through this informal approach and should be used 
as a basis for suggesting home study materials. The home 
study teacher will want to initiate much of this communication 
by calling or writing to the participant expressing a genuine 
interest in him and a willingness to provide him with the 
materials he wants. 

A file envelope was useful to hold all correspondence, 
order forms and resumes of phone conversations, information 
which can be noted on the front of the envelope. At a glance 
the home study teacher can get a quick overview of each person 
and estimate the extent of his participation by recording the 
dates of contact made by both the participant and RFD in the 
right-hand column. More detailed assessment will be made pos- 
sible by careful examination of the contents of the envelope, 
which contains correspondence, order forms, phone contact 
notes, etc. 

The RFD order form enabled participants to request home 
study materials and send problems and questions to Action Line. 
An original and three carbons were written simultaneously. 
Order forms were sent to anyone who requested a list of avail- 
able home study bulletins. In each case a business reply 
envelope was included as a convenience to the participant. 
Post card order forms for each unit were included in the intro- 
ductory material in the home study binders. Order forms, letters 
requesting home study bulletins, and Action Line forms resulting 
from telephone calls for bulletins were sent to the home study 
teacher. A quick check of a participant's file usually indicated 
whether or not the material requested in a given order should 
be sent. In some cases it was discovered that a participant 
ordered the same bulletins on more than one occasion. This 
could usually be cleared up with a phone call. Some order forms 
were received with every item checked. In these cases, the home 
study teacher expressed the project's desire that participants 
use materials one unit at a time to derive maximum benefit from 
the information in the bulletin, and then helped the adult 
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The h«)me-study order form enabled participants to request materials and send problems and questions to 
Aciion l.inc. U was alsc) used by the home-study teacher to order and record materials sent to a partici- 
pant. 
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The home-Study teacher used this envelope to record the participation of each participant. 
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identify particular informational needs. On the basis of 
this and other information in the participant's folder the 
home study teacher indicated on the order form those items 
that were to be shipped* 

The white copy of the order form (original copy) was 
retained by Action Line if it contained a problem or question 
for Action Line. The pink copy (first carbon) was retained 
by the home study teacher and filed in the participant's 
envelope. The blue (second carbon) and yellow (third carbon) 
copies were sent to the shipping department. The yellow copy 
became a packing slip and the blue copy retained as a shipping 
department copy. Incidentally, the shipping department copy 
proved to serve no useful purpose In the Wisconsin field test 
and could be eliminated. 



STORING AND SHIPPING MATERIALS 

Project materials must be stored systematically and con- 
veniently to permit rapid response to participant needs. 
During the RFD field test there were over 300 different items 
to store, some with as many as 1,000 copies. The project 
rented a 1500 square foot warehouse area, built storage bins, 
hired a shipping clerk, and developed a precise order form 
that indicated exactly who wanted what sent where. 

The shipping clerk received the marked order form from 
the home study teacher, walked along tiers of bins arranged 
according to content center units, found the desired unit, 
and sent it to the adult in a manila envelope. Materials 
were sent by third and fourth class mail. 

Ideally, materials should be shipped to participants 
within 24 hours of receipt of order. 
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THE RFD SYSTEM 

HOME VISITORS 
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Thf home visitor brought new information and companionship to the participant in ways ihe media could 
not. 
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HOME VISITORS 

The designers of this personalized mediated system shaped 
media to the needs and interests of disadvantaged and under- 
educated adults so that the adults could acquire educational 
and life coping skills and improve the quality of their lives. 
Yet they realized that media may target on the population but 
miss the individual. Personal contact was needed, particularly 
for the more disadvantaged and undereducated adults who are 
least able to acquire new skills on their own and incorporate 
new learning into their lives. These adults not only need more 
money and education, but also face a wide range of personal and 
family problems that are intensified by stresses of low income 
and undereducation, problems that may be so overwhelming that 
they blind the adult to possibilities for change and prevent 
his using the services of helping agencies and those of the 
mediated system itself. 

A major barrier to the undereducated adult's seeking out- 
side help for his problems is the discomfort he feels in the 
subordinite roles imposed by institutions and persons in 
authority, including teachers. His feelings are often based 
on experience. Yet he enjoys and feels at ease in informal 
peer relationships. An egalitarian and informal relationship 
was necessary to ensure that the system could actually help 
the participant. The system used home visitors for the fol- 
lowing reasons: 

* TO BRIDGE THE GAP BETWEEN THE PARTICIPANT AND THE 
DOMINANT MIDDLE CLASS SOCIETY . To Help him learn and interpret 
society's behaviors and participate in and use its social and 
helping institutions; to make the participant aware of available 
informational resources and services; to assist him to develop 
strategies to acquire information or services --this means help- 
ing the participant act rather than acting for him. 

* TO BE AN EMPATHETIC FRIEND AND CONFIDANT TO THE PARTICIPANT . 
To allow him to voice his feelings and problems and clarify what 
might be improved and how he might improve it; to help him iden- 
tify those needs which require satisfaction before others can be 
met; to help him articulate his needs for life coping skills based 
on his immediate situtation and needs; and to help him build 
self-confidence on a foundation of successful experiences. 

* TO FACILITATE THE PARTICIPANT'S USE O F THE SYSTEM'S 

TELEVISION. K0M5 STUDY' MATERIALS. RADIO AND TELEPHONE . 

To make the participant aware of these services and help him 
use them to learn and apply basic skills and life coping infor- 
mation. 



o 102 

ERIC 



-98- 

HOME VISITOR QUALIFICATIONS 

In Older to accomplish these functions the home visitor 
must possess certain personal qualities and know the project's 
goals and resources thoroughly. 

The question remains whether a professionally trained 
middle class person can bridge the gap between the participant 
and the dominant middle class society better than a nonprofes- 
sional who resembles the participant. There is much to recommend 
both in the role of home visitor. In any case, each would 
benefit from a careful examination of the other's life style. 

The RFD project recruited and used paraprofessional home 
visitors acquainted with the life style of the disadvantaged 
because professionally trained and experienced persons were hard 
to find and prohibitively expensive. It was also felt that 
paraprofessionals could work more effectively with the target 
population. 

RFD used eight half-time paraprofessional women (men refused 
to work half-time at the project's rate of pay) who were hired 
for nine months --four months of preparation and recruitment, 
and five months of implementation during which each one held 
weekly visits with six or seven participants. The visitors were 
supervised by three persons whose selection and use are described 
later. 

Although RFD used a regular weekly visiting schedule, other 
projects may find a flexible schedule more appropriate. Other 
programs also may wish to evaluate participant needs and prog- 
ress as visits continue, and reduce, interrupt, or terminate 
visits when the participant reaches a predetermined skill level. 
Individual home visits might also lead to group meetings once 
confidence is established and fears overcome. If full-time 
visitors are used, the workload would be 15-20 visits per week, 
depending on travel time. 
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SELECTING AND TRAINING HOME VISITORS 

RFD selected its par ap r of ess ion a 1 home visitors from 
persons recommended by social service agencies in the target 
area and through want ads and personal referrals. ScrceninB 
was by personal interview during which the interviewer deter- 
mined the individual's warmth, openness and friendliness, her 
ability to speak freely and express herself reasonably well, 
and the strength of her conviction that adults can learn. A 
nigh school diploma was a desirable but less important selec- 
tion criterion. 

The personal skills needed to achieve the project's ob- 
jectives are essentially those needed for friendship: interest 
m and sensitivity to the other person, ability to listen 
attentively, empathy, and warmth. 

Initial screening established that the visitors already 
possessed these skills to some degree, but a program of pre- 
service and inservice training sensitized the visitors to their 
role of friend and reinforced their learning by applying their 
knowledge to real-life situations. 

Training of professional persons as home visitors may 
resemble that for paraprofessionals if the home visitor is to 
be a friend, confidant and facilitator of learning. The pro- 
f'^ssional and nonprofessional both enter training with similar 
levels of social skills in friendship formation. 

The preservice training of home visitors consisted of 
cognitive learnings and an intensive field experience. 

Their inservice training was the responsibility of the 
supervisors, who helped them resolve personal problems of 
relating to clients as well as helping them identify needs 
and resources to help the clients. 



Information in training 

To prepare for their home visits with clients the home 
visitors read and discussed publications in 10 subject areas 
on learning problems of undereducated adults and on the qual- 
ities of friendship and helping behavior. Copies of publi- 
cations used during the field experience are available from 
RFD. The areas of study were: 

A view of self 

The nature of human needs 

Poverty ac a sub -cultural phenomenon 

The impact of illiteracy upon the life of the individual 
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A dofinition of education adequate to the needs of the 
adult poor 

The crucial conditions for learning 

Sub -cultural differences in language development unU the 
effectiveness of communication 

Individual differences in lekming style 

Relationships between expectations and human performance 

The nature of the helping relationship 

As training progressed the home visitors frequently commented 
on their new awareness of the complexities of friendship and 
cited personal field experiences which reinforced what they had 
learned by reading. 



Field Experience in Training 

In addition to reading and discussion » the home visitors 
prepared for their visits to clients by going out into the 
community (1) to gain experience interacting with the community's 
formal and visible leadership and (2) to identify and recruit 
potential participants for inclusion in the project's treatment 
(visited) and control (nonvisited) groups. 

Contacts with community leadership were important if home 
visitors were to fulfill their role as a bridge between the 
participant and the ''establishment.'* The visitors had to feel 
at ease dealing with the "establishment." In their search for 
participants the home visitors first contacted officials and 
agency heads in the four-county target area who referred them 
to appropriate agencies and individuals. In this way they 
learned to discuss RPD and its objectives articulately with per- 
sons who were already informed and whose cooperation had been 
solicited earlier by project staff. They also learned how to 
interact with community leaders» institutions, and social ser- 
vice agencies. 

The visitors used four criteria to select participants 
during recruitment: (1) an education below high school; (2) 
evidence of need for improving life coping skills; (3) potential 
of profiting from RFD and its home visits; and (4) urillingness 
to receive weekly visits. At the conclusion of their training 
the homo visitors had identified some 300 potential participants 
from which 100 were selected for treatment and control groups. 
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The RFD staff suggests that other programs begin as uri) 
did, giving a small field staff the opportunity to learn and 
practice its roles before serving as home visitors, and Inte- 
grating additional staff into the existing structure us new 
participants are added. 

Although the primary target population of the Wisconsin 
field test was the rural disadvantaged and undereducated adult, 
the experimenters found that urban areas contained many 
eligible participants as well. Population density became 
less significant to participation than the individual's needs. 
Participants were selected from rural and urban areas based on 
need and willingness to participate in the home visits. 



HOME VISITOR IMPLEMENTATION 



The home visitors were charged with the general goal of 
being a friend, confidant and learning facilitator to their 
clients. Their experiences varied widely, depending on the 
needs of the particular client. The visitors kept notes on 
their experiences which indicate that they were determined 
to help the individual and were inventive in finding ways to 
do so. Their reports also indicate that they grew to like 
their clients and that this feeling was reciprocated. 

During the field test the visitors encouraged the client's 
use of the print materials, television, radio, and telephone 
service. They helped the individual order materials and 
lugged videotape equipment to community centers in areas of 
poor reception.* They adjusted their schedules to those of the 
client and brought reading and math materials from RFD*s re- 
source bank, from home, from anywhere in response to the 
client's needs and interests. At times they simply chatted 
or helped with the children. 

After the project had ended the home visitors agreed that 
the personal rewards of being a home visitor were great. Many 
felt this was the most significant and meaningful job they had 
ever had. Some continued to see their former clients on their 
own, an indication of the strong bonds that developed. 

In one county the visitors were so successful that the 
area vocational -technical school hired them to continue their 
visits and expanded them to include other undereducated adults. 

The project's paraprofessionals were not trained as social 
workers or psychologists. During their field experiences many 
of them realized their limitations as paraprofessionals. They 
encountered problems of alcoholism, mental illness , child neg- 
lect, overprotection, mental retardation, marital instability, 
and desertion in addition to problems connected with poverty 
such as malnutrition and inadequate heat, housing and clothing, 
and those connected with unde re ducat ion such as illiteracy and 
inability to get and hold a job. 

Although they were not professional counselors, the home 
visitors tried to support the individual during times of per- 
sonal stress, help him learn how to cope with adult responsibil- 
ities, and assist him in seeking professional community help in 
resolving his problems. 



* a project uses home visitors and television programs, it 
should establish a television repair system to ensure that 
clients are able tc receive the television shows. 
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VIEW SUPERVISORS 



In addition to eight home visitors RFD employed three 
full-time supervisors. This ratio of visitors to supervisors 
was necessary in the RFD field test but in ongoing programs 
could be reduced. The field test suggests that the super- 
visor initially work with no more than three visitors and 
that additional visitors be added singly to a maximum of 10 
as the supervisor gains knowledge and experience and as the 
project adds participants. 

If a project uses professionally trained persons as home 
visitors, the number of visitors assigned to a supervisor may 
be increased because each visitor probably will require less 
encouragement and support during the project's early phases. 

Because the field test explored a relatively new role for 
the paraprofessional, accessibility to the supervisor was 
essential to ensure that the paraprofessional received all the 
assistance and encouragement she needed in that new role. 

Four criteria were used to select supervisors: 

Academic preparation preferably at the graduate level 

in one or more fields of education and behavioral science. 

Three or more years' experience as a teacher or practi- 
tioner in some form of education or social service with 
the undereducated and disadvantaged. 

Experience in supervising the work of other professional 
or paraprofessional employees. 

An intimate knowledge of the county in which the super- 
visory work would be done. 

The major responsibilities of the supervisors were 

(1) to ensure that the paraprofessional was able to relate 
new information to her preparatory experiences; 

(2) to counsel and assist the home visitor in accomplishiniz 
the project's goals both during training and during visits; 

^ (3) to assume a helping role in the life of the home 
visitor similar to that which the visitor was to assume with the 
participant; and 

(4) to act as liaison between the home visitor and the 
project's central staff. 
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SQMB PROBLEM AREAS 

Ho«e vifit prograns should be aware of four potential 
problem areas. 

1. There is a possibility of loss of contact with a par- 
txcipant. If there is one trait that characterizes the life 
of the disadvantaged it is instability- -psychosocial and 
physical (geographic). Family altercations and disruptions 
are frequent. Families also tend to move frequently and leave 
no forwarding address. These characteristics create problems 
for continuing the visits. 

2. The presence of preschool children is often a serious 
distraction, especially if the mother is the participant and 
the time of the visit precludes the presence of older children 
or the husband to care for the children. The program may al- 
leviate this problem if the home visitor brings one or two 
toys which the child has not seen before to distract him, per- 
mitting the mother to devote her attention to the visit. Care- 
ful selection of toys can be instructive for the child, and 
leaving a different toy for the child to play with between 
visits can extend this learning experience. 

The Wisconsin field test wanted to alleviate the distrac- 
tive problem of preschool children by having university stu- 
dents of early childhood education accompany home visitors as 
part of the student »s field practicum, but this endeavor had 
to be abandoned because student and home visitor schedules did 
not correspond. Other programs may be able to use such stu- 
dents to improve the quality of the home visits. 

3. The third problem uncovered by the Wisconsin field 
test was that of the "reluctant spouse." Several adults were 
willing to participate in the visits but were confronted by 
spouses who did not share their enthusiasm. Some of their 
reluctance was the result of deep suspicious about the program 
and disbelief that materials and services were free. Others 
felt threatened by the changes the program might produce in 
the spouse. Whatever the reason for reluctance it is important 
to secure the full cooperation of both marriage partners at the 
outset. 

4. Patience is essential. In some cases it can take 
weeks or months of relatively superficial visits before bar- 
riers are surmounted and an effective relationship established. 
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INTRODIK ' TON 

During the second year of RFD, the University of Wisconsin 
Psychometric Laboratory participated in the initial stages of 
the evaluation of the program. The evaluation work consisted of 
two major facets: (1) the development of materials to be used 
in the controlled experiment, and (2) a number of different attempts 
to obtain information about the program as the various facets were 
developed. 

The controlled experiment was designed to obtain definitive 
information about the effects of the home-visitor component of the 
program. In the design of the evaluation, a strong emphasis was 
placed on the evaluation of the home-visitor component, because this 
was the component of the project that had the greatest cost per 
participant. Fortunately, it was also the component of the project 
that was possible to control, in the sense of specifying who would 
receive it and who would not. There is, of course, no reasonable way 
to control who receives the television broadcasts or the content 
materials that were advertised. It was, however, possible to design 
a true experiment for the evaluation of the home- visitor component. 

In this experiment, subjects were randomly assigned to a 
treatment or control group, the treatment group members received 
home visitors and any other component of RFD that they requested 
and the control group did not receive home visitors but could watch 
the program or request materials. Because the use of evaluation 
experiments in the area of adult basic education is rare, if indeed 
not unknown, we have presented the rationale for it in 
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*'The Case for Evaluation Experiments'* beginning on page 114. Exper* 
imentation provides far better information than the traditional 
pretest-post test designs, and hopefully the RFD experiment will 
establish a precedent. 

For the experiment to yield good information, it was necessary 
to have a set of measurement devices that assessed attainment of the 
RFD objectives and that had excellent psychometric characteristics. 
During the first year of the RFD project, available instruments for 
adult basic education projects were reviewed and found lacking. 
Therefore, a complete battery of instruments was developed. The 
development of these instruments and their psychometric characteris- 
tics are described in "Development of Evaluation Instruments" beginning 
on page 175. The complete battery consisted of an adult achievement 
test, WITABE with subtests for language, computation, and coping 
skills; an attitude scale, WIAAI with siibtests for internal versus 
external locus of control and attitude toward learning; and a behav- 
ioral measure, "The World About Me." All measures were pre-tested 
on groups of appropriate adults and also on children in a rural school 
system at the appropriate grade levels. All tests, indeed even the 
subtests within each instrument, were demonstrated to have high relia- 
bilities. In addition, all adults who were tested appeared to enjoy 
the experience; there was no apparent rejection of the format. (Quite 
understandably, some of the children who were tested did not know 
how to answer some of the questions; e.g. "Do you have a job?") 

The battery of evaluation instruments was administered to the 
individuals in both the treatment and control groups in May and 
June of 1971. The analyses of these data have been part of the third 
year activities. 
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Some nonexperimental information was also gathered in the 
treatment group through the home -visitors . In a later section the 
material gathered from the home visitors is presented. The sub- 
jective reports of the home visitors, while far from "hard" infor- 
mation, is informative. Every home visitor agreed that working for 
RFD had been a rewarding experience; each one felt that both she and 
the participants with whom she had worked had profited from the pro- 
gram. While the home visitors also had many suggestions for changes 
in the program, all agreed that they would like to work again for a 
program like RFD. Their enthusiasm and commitment to the program 
was clearly evident and extremely impressive. 

The second major aspect of the evaluation activity during the 
second year was a variety of attempts to gain information about the 
RFD materials and format as they were developed. Originally, it 
was thought that this information would be easily obtained. With 
great naivete it was proposed that experiments be conducted with 
available groups of subjects that were considered to be in some 
sense comparable to the target population, for example students in 
ABE classes in the vocational schools. In implementing this plan, 
however, it was quickly evident that such groups of subjects did 
not exist in the numbers that were necessary. ABE classes were very 
small in registered enrollment and whenever they were used in the 
evaluation, almost half of the students were absent. In a 
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further attempt to obtain subjects, we offered to pay groups for 
every person who appeared. This proposal seemd to appeal to the 
groups approached, but again and again only a few people would 
appear at the scheduled session. This difficulty in luring people 
like those in the target population to a central location for any 
purpose seemed to substantiate the RFD claim that these people 
must be reached in their homes. 

Because it was so difficult to get subjects to come to a 
central location for evaluation sessions, we expanded our design 
to include telephone interviews. Several different interview 
samples were used; people from the RFD participant file, samples 
from a rural phone directory, and a group of people who had been 
identified for RFD as potential participants. Reports of the group 
evaluation sessions and the phone surveys appear beginning on 
page 119. 

No single piece of information in these reports is of any value 
alone, for the groups were small and often some of the participants 
had inappropriate educational levels; only when the same information 
appears a number of times do we begin to have confidence in its 
accuracy. 

In spite of the weakness of individual pieces of the data, a 
number of general trends did emerge. Almost every person who was 
asked about RFD, whether in groups or on the phone, was enthusiastic 
about the program. People were amazingly uniform in their reports 
that they not only liked the RFD program, but they also had learned 
from it. Different people like different parts of the television 
program, but the Hints were a clear favorite of almost everyone, 
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After the Hints, the most frequently approved aspect of the program 
seemed to be the general atmosphere: many people commented that 
they liked the way Jim Mader ran the show, the rural aspects » the 
homey touch, etc. These comments were interpreted to mean that 
the general tone and style were liked. 
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INTERtlAL EVALUATION 

THE CASE FOR EVALUATION EXPERIMENTS 
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A common evaluation strategy in education is the pretest- post 
test design. This design includes the following steps: 

1. Test the participants before they begin the program 
(pretest) . 

2. Apply the educational treatment. 

3. Test the participants at the end of the treatment 
(post test) . 

a 

4. Compare the pretest and post test scores to deterniine 
if there has been any change. 

If any change occurs, it is assumed to be a result of the 
educational treatment. This strategy is basically fallacious and 
cannot lead to definitive statements about the effect of the treat- 
ment since it must be assumed that the treatment has caused any 
change. A researcher who adopts the pretest-post test design is 
required to assume precisely that which he should be trying to 
demonstrate . 

Unfortunately, no information from the pretest-post test study 
can be used to support this basic assumption - that pretest to 
post test changes are caused by the educational treatment. The 
changes could be due to the mere passage of time and the concomitant 
development of the participants. This is an especially serious 
problem when the participants are children and the program lasts 
any appreciable period of time. When participants have volunteered 
or are self-selected into a program, as is the case with RFD, changes 
can be expected in participants without the program. It is likely 
that the people who sign up for a program like RFD have taken the 
first step toward changing: they have at least recognized and openly 

1^0 



declared a need to change, and may already be in the process of 
changing on their own. Therefore, it is excremely likely that change 
will be observed from the pretest to the post test, but it may have 
occurred without the treatment. Another way the passage of time can 
affect change scores is that something may happen quite unrelated to 
the educational program that will improve participants' test scores. 
For example, a new movie may lead people to change regardless of 
their participation in the program. Or, a church or other civic 
organization may begin a similar program or begin a campaign to 
motivate change. All of these uncontrollable and many times unknown 
factors, unrelated to the program in question, can induce what may 
look like a change by the program, but would have occurred anyway. 

A second major problem with the pretest-post test design is 
that the pretest itself may cause participants to change. By 
testing participants at the beginning of the program they will 
become alerted to the goals of the program. Simply taking the 
test and then thinking about it over time may be sufficient to 
bring about observed improvement on the post test. Because the 
pretest per se is not part of the treatment, the effect of the 
pretest cannot be attributed to the treatment. 

A third problem with the pretest-post test design in a program 
like RFD is that the participants are likely to be distressed by 
any testing in the early stages of the program. As a result, some 
people may drop out of the program or not participate at all when 
they discover that the first activity is a test. At best, they may 
feel that their own improvement and growth is less important to the 
program staff than their pretest score. 
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In evaluation studies in general and particularly in the 
evaluation of RFD, we reject the pretest-post test design in favor 
of an experiment randomly assigning persons to a treatment and a 
control group. The first step is to define a pool of suitable 
subjects, some of which will be randomly assigned to the treatment 
or control conditions. In the case of RFD, acceptability was deter- 
mined by the following three criteria: (1) the person must have been 
willing to participate in the program; (2) the person must have had 
suitable educational level as indicated by his application form and 
the judgment of the field staff; and (3) the person had to live 
within a reasonable distance of the home visitor*s residence. Any 
person satisfying all of these criteria was included in the pool 
from which they were randomly* assigned to the treatment or control 
group. The treatment participants received the full RFD treatment 
with home visitors; the members of the control group were permitted 
to participate in the TV portion and receive home study materials, 
but they did not receive the home visitor. At the end of the program 
both groups were tested on all evaluation measures. Differences 
between the treatment and control groups were then a definitive meas- 
ure of the effect of the treatment, in this case the home visitor. 

Because both groups were tested at the same time using the 
exact same procedure, there was no possibility for the passage of 
time to bias the outcome of the experiment as is the case with the 
pretest-post test design. Because the groups were constructed by 
randomly assigning participants from the same pool, there could be, 
on the average, no systematic differences between the two groups. 
This enabled us to apply inferential statistical methods to the 



*Randomly as used here is a technical term and does not mean 
^♦haphazardly. 12,3 



data in order to decide whether the treatment was superior to the 
control condition. We cannot tell how much individuals changed. 
But, this is a somewhat irrelevant question. We can determine how 
much change was caused by participation in the program. This is 
the information that is required in order to decide if the program 
was a success. 
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INTERNAL EVALUATION 



GROUP EVALUATIONS OF TELEVISION TAPES 
AND CONTENT CENTER 
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In the original evaluation proposal, the TV tapes and content 
materials were to be evaluated by taking them to appropriate groups 
(similar to the target population) for experimental evaluation. 
Subjects were to be randomly assigned to a treatment group that saw 
the program or a control group that did not see the program and 
then both groups would be given an achievement test at the end to 
see if the treatment group had learned something from the program. 
Two factors led to a change in this strategy. 

1. Appropriate groups of subjects were almost impossible to 
find and adequate numbers of subjects for experiments were simply 
not available. A number of ABE classes around the state were used, 
but the classes were usually small in their official enrollment and, 
on any given class day, about half the class was absent. Because 
the ABE classes were so disappointing, an attempt was made to arrange 
other groups. Several Head Start Parents Groups were approached. 
These groups were offered two dollars for each person who appeared 
at an evaluation session. The proposal was greeted with great 
enthusiasm as each group wanted to raise money for special projects. 
Nevertheless, no group was able to produce more than eight people 
at a session even counting the Head Start staff. (The difficulty 
that was encountered in getting target population people into a 
central location underscores the need for a program, like RFD, that 
goes to the participant in his home.) 

2. The most valuable information obtained from the groups of 
subjects appeared to be the opinions about the program- -what they 
liked and disliked. Since the programs were still in production, 
the suggestions of these groups could be incorporated into the later 
tapes . 

ERIC 



Therefore » group sessions focused on general discussion of 
the TV tapes. 



The data from these group discussions is presented in rather 
great detail. The reader should not be misled by the quantity of 
numbers into thinking that these reports contain definitive conclu- 
sions. In general, the groups were very small and often they 
consisted of several people who were too well educated to qualify 
for the target group. It is only when the same information appears 
consistently in different sources that it becomes convincing. The 
data are presented here in detail so that as future research is 
conducted the cumulative effect can be assessed. 

On some points, the data were clear and consistent: (1) 
respondents were generally very favorably impressed by the content 
materials; (2) respondents consistently reported that they enjoyed 
the television programs and also that they had learned from them; 
(3) the Hints were widely considered to be a favorite part of the 
t. levision programs. 
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Evaluation of Pilot Program # 7 

The prototype tape was evaluated on October 9, 1970 with students 
attending Skill Development Center, Beloit. In all, fifteen students 
participated (ten males, and five females). Most of the students 
were relatively young (eighteen to thirty) , but five students were 
over thirty. Approximately half of the students were black. 

First, the tape was shown on video to all the students sitting 
together. They were told that this was to o*>tain their suggestions 
and to find out how relevant this material would be for them. 
After showing the tape, the students were divided into three groups 
with one member from the Psychometric Laboratory in each group. 
The students were asked to complete a two-page questionnaire (page 125). 
Then the group discussed the tape. General comments as well as 
comments with regard to each item shown on the tape were obtained 
during the informal group discussion. 

General Comments 

In general, the students were very enthusiastic about the tape. 
They seemed to enjoy watching it and appeared pleased to be asked 
for their opinions. (Of course the novelty of the event might 
account for a fair portion of the enthusiasm) . Some students thought 
the tape was too jumpy and too many topics were covered in the time 
period. This reaction may have resulted from the fact that the 
transitions were technically weak on the tape. 

The telephone number was incorrect in one place and Jim Mader 
put a letter into an envelope twice. 
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Some students did not rsalizt that the telephone calls were 
toll-free. That information should be spoken as well as written. 

Some students thought the screen -mending hint and the dry milk 
hint were commercials. The implications of this conclusion are not 
clear, but it possibly means that the information would be looked 
upon with skepticism. 

Few students remembered that they had been told that they could 
send for additional materials, but sending for additional materials 
was not emphasized on the tape. 

A number of additional topics were suggested: sports, political 
stories, current events, stories about other countries, more about 
social security, how to look for an apartment, balancing a budget, 
recipes, gardening, more hints, pollution, state and local govern- 
ment, world sports, world news, information on school subjects like 
science and history. 

Comments Made on Specific Parts 

Preparation of dry milk -- It seemed to have little impact, 
maybe due to the fact that most of the students had made dry milk 
before. One student disagreed with the instructions and several 
suggested more complicated uses, such as the preparation of buttermilk. 

On poisons --The responses were generally positive. Most students 
said that they knew that many household products were poisons, but 
that they had not realized how many. One student pointed out that 
"away from children" was not the only criterion for good storage- - 
for example, gasoline should be stored away from fire. 
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Library --A nuaber of students did not even remember this 
segment* When reminded of it, they agreed that libraries were 
good places, but one had the feeling that they were good for some- 
one else. Several mentioned how important it was to teach children 
to use a library. The only personal commitment came from one 
student who said that you could go to the library to "look things 
up." One was given the impression that for these students "reading 
books" is a frivolous and childish activity. Perhaps RFD should 
stress the practical uses of the libraries. 

Hog Raising - -This section was irrelevant to these students. 
The students thought that this might be interesting to people who 
live on farms. 

Boiling Spaghetti - -It had a very positive response. Most of 
them had not heard of using oil to keep the spaghetti from boiling 
ovcr» and said that they would try it in the future. 

Mending Screens --Very positive response. They liked the idea 
and also the presentation. 

Local Community Festivals - -A mixed response. A number of students 
wondered why it was there- -it did not seem to fit with the rest of 
the program. (Perhaps they should have been shown a map with the 
location marked, so that they realized that these were neighboring 
communities. On the other hand, the target population may know the 
communities .} 

Action Line on Social Security - -Received a very good response, 
but these students had studied a unit on social security. Some 
complained that they were not told anything. But others said that 

the message was clear-"get the facts." 
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TELBVISION PILOT EVALUATION QUESTIONNAIRE 

Please answer the follOMing questions so that the IV program in the future 
could be improved. 

1. Are you a man S or woman 10 

2. How old are you . 

3. How many children live with you . 

4. Was this TV show Bad 0 ; O.K. 6 ; Good 9 . 

5. Were the words used in the TV show Easy 9 ; O.K. 6 ; Hard 0 . 

6. Was this TV show Fun 2 ; O.K. 13 ; Dull 0 . 

7. Will you be able to use something you saw on this show? 
Yes 9 ; Maybe 4 ; No 2 . 

8. How did you like the festival stories? Bad 1 ; O.K. 4 ; Good 10 . 

9. How did you like the music? Bad 0 ; O.K. 8 ; Good 7 . 

10. Itow did you like the hints? Bad 1 ; O.K. 7 ; Good 7 . 

11. Wliich did you like best? Festival 3 ; Hints 7 ; Music 5 . 

12. Would you like to see more of these TV shows? Yes 9 ; Maybe 4 ; No 

Notes ; 

n The actual ages given were 18, 21, 21, 22, 23, 24, 27, 28, 29, 29, 

34, 40, 41, 44, 46. 

#3 The actual answers were: 3 had no children living with them; 

7 had 1 or 2 children; 

3 had 3,4, or 5 children and 

2 had 7 children. 

#11 - All three vdio chose festival were over 40. 
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How long should you chill the milk so that it will taste best? 

2 hours 3 ; 6 hours 3 ; 12 hours 7 . 
What are the best kinds of hogs on today's narket? 

Lean 11 ; Red 2 ; Fat 0 . 
Where is the best place to get hogs? 

Grocery 0 ; Certified breeder 7 ; Farmer 6 . 
Check some household poisons: 

^tothballs 12 Insect poisons 11 

Crayons 6 Medicines 11 

Paint 12 Toys 1 

Eggs 0 Scissors 3 

Where is the best place to keep household poisons? 

Under the sink ; In a closet 2 (these two also checked high shel f ) 

On a high shelf 13 . 
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Evaluation of Tapeg »2 and »4 

Tapes #2 and #4 were taken to the Sun Prairie Head Start 
Parents Group meeting on February 1, 1971. We were expecting 
twenty-five to thirty parents and friends of parents to parti- 
cipate in the evaluation and we had arranged to pay the Head 
Start Parents Group $1.50 for each person who participated. 
Only nine people showed up and five of these were staff or 
relatives of staff. The educational level of the group was 
highly inappropriate: there were two with Bachelor's degrees 
and two more with Master's degrees. However, because we are 
arranging to add to our sample through other Head Start groups, 
we shall describe the procedure. 

1. We arranged video tape equipment in two rooms of the 
Methodist Church Hall in Sun Prairie. Participants were randomly 
assigned to one of the two groups and they were then shown 
either tape #2 or tape #4. 

2. After the tape viewing, all participants were asked 

to answer achievement paper -and-pencil items. These items were 
based on both tapes. The intent was to demonstrate that those 
who saw tape #2 scored significantly better on those items, 
while those who saw tape #4 scored better on the other items. 

3. After completing the short tape -specific achievement 
test, participants were arranged in groups of four or five to 
participate in a structured group discussion of the tape. In 
the discussion they were asked general questions first and 
then they were asked about each of the major parts of the 
tape. 
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4. In addition to the tape -specific items, we asked all 
participants to complete the three parts of our general 
adult achievement scale, our measure of internal vs. external 
locus of control, and some of our behavioral items. These 
last instruments were administered to obtain information for 
scale refinement. 
Results 

There were not enough participants to make the achievement 
date interpretable, but the scores are presented in Table 1. 
Although the differences are small, they are at least in the 
expected direction. 

The group discussions must be interpreted in light of the 
size and composition of the groups. 

Tape #4: Participants were four females between the ages 
of twenty -four and forty -five. Three of the four had college 
degrees (two had Master's), the fourth, a thirty-two year 
old, had a grade eleven education. 

What did you like best? Household hints, the story about 

Blackhawk, the way they had 
children in there. 
What did you like least? The history part --the way they 

used the paintings -and they didn 
connect it to Madison. The Uncle 
Sam part was too contrived. 
How would you change it? Make it not stilted. They are 

trying too ha^d for an effect. 
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Did you like the puppet? Hie woman with the grade 11 education 

thought the puppet was great. The 
other three thought (1) that the 
segment was O.K., but too long; (2) a 

I 

bit much like Sesame Street; (3) amusing 

but too drawn out. 
General comments : Once again the greatest enthusiasm was shown 
for the hints. In Blackhawk, like the festival section, there 
seemed to be a need to show a map with the location of these 
places. It is amazing how provincial even this well educated 
group is. 

Specific comments: 

Huntley interview: Interesting, but all had heard him make 

these points before. 
Good, learned things. 
Interesting, but stilted. 
Not enough facts, made us want to get more 
information, should be related to local 
history (apparently, the segment achieved 
the desired purpose --it aroused interest.) 
There seemed to be a need to show maps --these 
people did not know that Sauk City was nearby. 
Entertaining, too long. 

Three liked him a lot, one did not like him-- 
th ought he was too folksy. 



Poisons: 
Uncle Sam: 
Blackhawk: 



Shopping Puppet: 
Jim Mader: 
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Tape »2 : Participants were five people (three males and two 
females) . The age range was twenty-eight to thirty-seven 
years. Except one lady, no one knew about the RFD program before. 

For discussion purposes, we asked for their overall opinion as 
well as their opinion about (1) talk with Eddie Albert; (2) 
legal rights; (3) wildlife; (4) festivals; (5) meaning of 
friendship; (6) hints. 

The best liked item was "hints" safety precaution with car, 
using nail polish in thread loop, extra storage space, avoiding 
car window fogging. All respondents gave a very high positive 
response. They also liked the music of the program and its 
presentation very much and also Jim Mader. 

The least liked item was "New Glarus Festival." Three people 
would not like to see it in such a program and two had no 
opinions. They said that this item had no beginning or end. 
The presentation was also not good. 

Talk with Eddie Albert: Was liked in general. One said that 

he gave only his point of view. A 
discussion giving the other side 
would have been better. Others said 
Lhat the term "organic" is misleading. 
Organic things may not always be good, 
e.g., amonia is harmful. 
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Legal Rights; A very positive response. Comment was 

that everyone should know these things. 
One wanted to have more details, but 
others said it is for the individual 
to find things according to what he needs. 

Wildlife: Response was neutral. They were more 

interested in how the wildlife could 
be of use rather than being told that 
they are of use. They wanted more 
details of usage of wildlife. 

Meaning of Friendship: They thought it was "cute." A good 

"yes" response. 



TABLE 1 

Mean Scores 

Exposed to #4 Exposed to #2 
Items from #4 3.75 2.60 

Items from #2 3.50 3.80 
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Bvalxiation of Tape #6 

Tape #6 was shown on February 1971 to six people belonging 
to the Head Start Parent Group at Sun Prairie. All of the partici- 
pants were women with the age ranging from thirty to forty- six 
years. Four of these had completed their education up to high 
school and two had two years of college education. Two of the 
women had participated earlier in the evaulation of tapes #2 and 
#4. 

The tape was shown to the whole group. They were then asked 
to respond on general questions about the tape. 
Their responses to questions asked were as follows: 

1. Was this TV show Bad 0_; O.K._4 ; Good 2_. 

2. Were the words used in this show Easy 4 ; O.K. 2_; Hard U . 

3. Was this TV show Fun 0 ; O.K._6 ; Dull 0_. 

4. Will you use something you saw on this show? 
Yes 6_; Maybe 0_; No 0_. 

5. Would you like to see more of these shows? 
Yes 6_; Maybe 0_; No 0_. 

6. What did you like best? Talk with children about "happiness" 

was the most liked and then "hints," 
sugar in salt shaker, waxing the 
snow shovel. 

7. What did you like least? Four respondents had nothing to 

say. One did not like "cartoon" 
and another remarked "estate 
settlement information." 

8. How would you change it? By having more household hints, 

^ ^ visit to more interesting places, 
ERJC having more about children. 
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After getting responses to the general evaluation sheet, an 
informal discussion was held to solicit opinions about individual 
items. The following comments were made: 

Ray Beckman: Two persons were already exposed to the idea of 

conservation. The idea of conservation was 
generally appreciated and efforts of Beckman 
praised. One person did not understand what 
it was. Wanted more information on how to 
proceed to get a conservation project done. 
Children - on "Happiness:" This had a high positive response 

of likableness. To one it made her 
think about her own children. 
Another heard and watched children 
like this for the first time. 
Wanted more ideas (like bird feeder) 
for things children could do. 
Puppet on Credit Card: A neutral group response was observed. 

One said it was oversimplified for an 
adult. Information was useful. 
Estate Information: This portion was not liked in general. 

First, it had no relevance for them. As 
far as information presented, he (the 
president of the First National Bank) did 
not say anything. "Of course," one said, 
we have come to know that the law will 
change on April 1." 
Hints: (a) Sugar in salt shaker, (b) waxing the snow shovel, 
(c) egg beater used for mixing paint--were some of the 
most liked items of the show. The hints (a) and (b) 

er|c 1^8 
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were very positively taken and most of them said that 
they will try it. The idea of using an egg beater 
was not much appreciated. One said that it might be 
hard to do. 

General: A scenic pattern interposed between the various parts 
was not appreciated. It did not mean much in black 
and white. 



Regort on Content Material 
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The content material "About Me and My Money,*' Part I: "About 
My Home" was taken to Sun Prairie Head Start Parents Group on 
February 8, 1971. The group composition was the same as for the 
evaluation of tape #4. The content material was given for their 
evaluation after the task of evaluating the tape was completed. 

The following pamphlets were given to each member of the 
group: 

Health, Safety and Sanitation 
Emergency First Aid I 

Bulletin 3D1-1 
Home First Aid 2 

Bulletin 3D2-1 
Home Safety Plan 3 

Bulletin 3D3-1 
Knowing the Signs of Illness 4 

Bulletin 3D4-1 
Home Sanitation 5 

Bulletin 3D5-1 

They were asked to go through the materials and decide whether 
the materials were readable, understandable, believable and relevant. 
They took about thirty minutes to go through the materials. The 
frequency of responses were as follows: 
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1. What is the ease of reading? 



too 
difficult 



somewliat 
difficult 



generally 
readable 



too talking 
0 0 



2, What is the ease of understanding the content? 
very clear understandable generally 

4 1 1 



not clear confused 
0 0 



3. What is the believability level of content? 



strongly 
believable 



very 
believable 



generally 
believable 



SGmewhat not 
believable believable 



4. IVhat is the relevance of the context? 



can use can use 
immediately later 

1 0 



generally 
usable 



use will not be 
questionable used 

0 0 



General: They conmented that almost all the information was very good 
and usable in day to day life. 
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Bvaluation of Tape »7 

Tape #7 was taken to the Sun Prairie Head Start Parents Group 
meeting on February 8, 1971. Five people showed up, all of whom 
were women. Their ages ranged from twenty-eight through forty- five 
years. The average number of years of schooling for the group was 
thirteen years. 

The tape was shown to the group. Their frequency of response 
on general statements of the evaluation sheet were as follows: 

1. Was this TV show Bad 0_; O.K._l ; Goo d 4 . 

2. Were the words used in this TV show Easy_4 ; O.K._0 ; Hard 0_. 

3. Was this TV show Fun 2_; O.K. 3_; Dull 0_. 

4. (a) Will you use something you saw on this show? 
Yes 3_; Maybe 2^; No 0_. 

(b) What will you Use? Baking mix, grease pencil, driving tip. 

5. Would you like to see more of these TV shows? 
Yes 4_; Maybe 1_; No 0_. 

6. What did you like most? Baking tip 1_; Driving tip_J ; 

Eds el 1_; Irene Ryan 1 . 

7. What did you like least? Scholarship guy. 

After filling out the general evaluation sheet, a group discussion 
was held by the participants to evaluate the tape, part by part as well 
as an overall impact on the audience. 

i:clebrity: Irene Ryan-- It was thought to be a good start. It 

was entertaining, rather than informative. 
Puppet: Edsel--Most took this part very favorably and were 
able to relate it to their home life meaningfully. 
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Those who watched earlier shows thought this puppet 
representation better than any of the previous ones. 
However, one in the group thought it below the level 
of an adult to take information from a puppet. 
Environment: Senator Nelson- -Message did not seem to reach 

anyone in the group. One commented "Proxmirc 
didn't have much to say," 
Home Nursing: Only one positive response, the rest of the 

group being neutral. 
Scholorship Aid: It was considered to give useful information, 

but the presentation was not appreciated. 
Recipe: Master mix- -Two had made similar things already. A 

generally favorable response. 
Hints: Grease pencil- -Was not too well received. 

Driving in fog- -Was considered good. 
General: Of the two who saw earlier shows, one used the 

Action Line and made a deal with her kids to watch 
RFD. The other sent for the written materials. 

There was nothing in the show that was not liked in general. 
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The content material "Joy of Good Food" was evaluated with 
the same group of Head Start Parents Group as for the preliminary 
evaluation of tape #7. The material was distributed to each member 
of the group. They were asked to leaf through the material and 
give their responses, especially to Unit #1. 

Most of them found the game interesting enough to play. They 
affirmed that they could use the game placemat as a menu planner 
for meals for a whole week. It was considered a good way to get 
out of a rut. 

The responses to the evaluation sheet were as follows : 
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1. What is the ease of reading? 

too somewhat generally too easy talking down 

difficult difficult readable 

0 0 4 0 0 

2. What is the ease of understanding? 

very clear understandable generally not clear confused 
clear 

3 0 10 0 

3. What is the believability level of the content? 

strongly very generally somewhat not 

believable believable believable believable believable 

2 110 0 

4. What is the relevance of the content? 

can use can use generally use will not 

immediately later usable questionabl e use 

4 0 0 0 0 
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General comments: Very good and useful information, very 

interesting and educational, information 
pertains to my job as a cook and very good 
indeed. 
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Evaluation Report on Program #8 

On March 3, 1971 ten women who belong to the Parent Group of 
the Mazomanie Head Start Program were shown the RFO tape #8. Tliis 
group of women (all white) ranged in age from twenty- eight to fifty- 
one years and ranged in formal education from the eighth grade to 
the second year of college. Seven of the women were currently 
Head Start parents, two were Head Start teachers (and had once been 
Head Start parents themselves) and the tenth was the Parent Worker. 

After showing the tape they were asked to respond on our 
General Tape Evaluation Questionnaire. The responses were as 
follows: 

1. Was this TV show Bad 0_; O.K. 5_,; Good 5_. 

2. Were the words used in this TV show Easy 10 ; O.K. 0__; Hard J) 

3. Was this TV show Fun 6__; O.K. 3__; Dull 0_. 

4. Will you use something you saw on this show? Yes 7_; Maybe 2 

No 0_. 

5. What did you like most? Montgomery's advice 2_; 

Camping outdoors 4 ; Hints 2 ; Idea about antiques 1_. 

6. What did you like least? Seven people left the item 
unanswered. Three did not like the selection of song for the 
music. 

A group discussion was held later to obtain reactions to various 
parts of the program and to invite their free coininents. 

Goose Island Ramblers: People were generally happy to sec the 
(local music group) 

Ramblers on the show, but did not like 
the selection of the song by them. Two 
of them said that they would prefer more 
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quiet and relaxing music. 

Treasure Shop: Three or four in the group were very much 
(antiques) 

appreciative of the idea. In general this 
part of the show gave favorable comments. 
Several gave other ideas of household things 
which can be converted into valuable antiques. 
Leisure and Recreation: This part was very much liked by almost 

the entire group, particularly because 
* it showed a happy family cooperating. 

However, parts of it were hard to see 
because they were night scenes and 
Nature doesn't show up very well on 
black and white TV. 
Charlotte Montgomery: Her suggestions were liked in general. 

Some said comments were "very useful" and 
that they had "learned something." One 
person showed a desire to have her own 
copy of Montgomery's book because it had 
ideas for entertaining children. 
Hints: Three indicated that they would try removing crayon off 
vinyl. Two indicated that they would use the hint 
about washing walls. The idea about cleaning of glasses 
was liked in general, but one remarked that the method 
didn't work. 

General: These people responded with notable enthusiasm to 

all of the parts of the show except for the selection 
of the music by the Goose Island Ramblers. Several 
expressed appreciation of the variety and the lack of 
the commercials in the program. One said she liked 
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the "point of view.'* Two o£ the women have been 
watching this show almost regularly. (An RFD 
home visitor is currently visiting one of these 
women.) Some said they were having difficulty 
in receiving Channel 21 on their television sets, 
but if it weren't for that they would like to 
watch the show. Several indicated that more 
publicity of the program timings was meded. 
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INTERNAL EVALUATION 

RFD TELEPHONE SURVEY REPORT - PARTICIPANTS 
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To gain information about who was responding to RFD and what 
they liked about the program during the 9th through 12th weeks, a 
random sample of 175 names was drawn from the total participants' 
list of 2,934 individuals. The total list consisted of personi; who 
in some way communicated with RFD they requested materials, wrote 
it:ters regarding the program, called the Action Line, etc. 

Of the 175 names, 90 were reached by telephone. Telephone calls 
were made primarily in the evening between 7 and 9 P.M. as this was 
found to be the best time for responses. People who were not reached 
on the first call were called again at least twice. 

Each phone interview followed the same format: 

1. The interviewer introduced himself as being from the 
University of Wisconsin calling about RFD. 

2. The interviewer asked whether the respondent had ever 
seen RFD, and if so, how often. 

3. If the respondent had seen RFD he was asked if he had 
seen the current or previous week's program. 

4. If the respondent had seen a current program, he was 
asked about each segment. 

5. If the respondent had seen any programs, he was asked 
what he liked best and what he liked least. 

6. The respondent was asked if he was willing to participate 
in a mail survey about each program. 

7. Finally, the respondent was asked his age and educational 
level. This was approached by stating that the inter- 
viewer wanted to ask some personal questions and the 
respondent could refuse to answer but "we are very 
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interested in knowing who is watching our program." 

This approach seemoc to be very effective because 77 of the 

90 people gave us their ages. 

Of these 175 people, 90 were actually reached by telephone. 
Seventy-two were female and 16 male. Two people failed to designate 
their sex. 

Seventy-seven people gave their age and for them the average age 
was 45 years. Thirteen did not give their age, but six of these 
were judged to be over sixty. 

With respect to education, forty -seven had finished high school, 
twenty had their Bachelor's degree, nine had completed the 8th grade, 
one each had completed the 9th grade, 10th grade, 1 and 3 years of 
college. One person had a Master's degree and one was an R.N. Eight 
people did not answer this question. 

In response to the mail survey question, ten people answered 
NO and seventy-four answered YES. Six people did not answer this 
question. 

With respect to the previous week's program, fifty-five people 
said they had not seen the previous week's program, thirty-three said 
that they had watched it and 2 did not answer this question. 

In answer to how often they watched RFD, the response frequencies 
for these ninety people were as follows: 
Every week 35 
Often 17 
Occasionally 10 

Twice 15 
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Once 
Never 



10 
3 



Ninth TV Program ! 

Of 30 people selected for telephone questioning about the 
March 3 RFD program, 24 were contacted between March 7 and March 13. 
One -fourth of those contacted were male and three -fourths female. 
Their ages ranged from 21 to 67 or more years, with a mean ago of 
43 years. The educational range was from 8th grade to a Master's 
degree, with the heaviest concentration (13 Ss) at the high school 
level. Five people had a Bachelor's degree and most had some educa- 
tion (college or vocational) beyond high school. 

Twenty-one responded "yes" to the mail survey question, one 
responded "no" and two did not answer the question. Seventeen 
out of the twenty- four had not watched RFD the previous week. Half 
of the people said, however, that they watched most or all of the 
time. The others had watched never (1), once (3), twice (5), and 
occasionally (3). The people who watched regularly were most enthus- 
iastic about Jim Mader and the "Hints." There was some indication, 
however, that the hints came too fast or were sometimes difficult to 
follow. The informal rural aspect of the program was appreciated. 
These people also liked the Action Line, recipe contest, economic 
suggestions, and stories about Wisconsin. Many would like to see 
more on pollution, but did not like or understand the "junkyards" 
segment. 

There appeared to be no general dislikes or explanation lor tht- 
in frequent viewers. 
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Tenth TV Program ! 

Between March 15 and March 20, 28 people were contacted for a 
telephone interview about the RFD program. Of these people, 2 2 were 
female and 6 were male. Their ages ranged from 16 to 70 years, with 
a mean age of 46 years. Four had finished college, 19 high school, 
1 the 10th grade and 3 the 8th grade, and one person did not answer 
the question. In answer to the mail survey question, 23 responded 
"yes" and 4 "no." Twelve said they had watched RFD the previous 
week and sixteen said they had not seen it. These people tended to 
be frequent RFD viewers, more than half watching occasionally to every 
week: every week (13), often (2), occasionally (7), once or twice (6). 

Most popular by far with these people was the history of 
Wisconsin part of the show. They liked Jim Mader, the Action Line, 
and RFD in general. 

Some people would like to see the program be more rura deal 
with farming problems and child care. Others would like more pure 
entertainment. They were not especially impressed with the celebrities 
interviewed. Edsel was disliked and there were complaints of too much 
junk mail. 

Eleventh and Twelfth TV Programs : 

From a list of 76 home study participants, 38 were contacted for 
a telephone survey about the March 15 and March 22 RFD programs. 
Contact was made between March 24 and April 6. There were 33 females 
and 5 males in the group. Their ages ranged from 16 to 75 years, with 
a mean age of 41. Six people had completed school through the 8th 
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grade, 1 through the 9th grade, 15 through high school and 11 were 
college graduates, and 5 people did not answer. Twenty- five watched 
the RFD program often or every week. Thirteen were infrequent or 
occasional viewers. Twenty-two had not seen RFD the previous wcuk» 
but 16 had* Thirty responded *'yes" to the mail survey question and 
five responded "no.** 

Once again, Jim Mader, "Hints,** **Action Line," the bulletin and 
economic suggestions were much appreciated. The chicken recipe was 
tried and said to be "good." Johnny Cash was liked. The Henry narrow 
interview was considered **fine," although some interviews "are not 
too good." The logging film (history of Wisconsin) was ''excellent/' 
giving a "nice perspective of something you never considered before." 
People liked the part on buying hogs because it was appropriate to 
their interests. In general, they thought the program and literature 
were good; "good program because it responds to the wishes of the 
people." 

The non-watchers were disinterested and without any specif^: 
suggestions or complaints. 

Regular viewers who generally liked the program had some sug- 
gestions and criticisms. A few mentioned that the "first program 
was best." Many complained that the "Hints" and interviews went 
too fast and were thus difficult to follow. They would prefer to 
see local people interviewed. The "greasing pan" hint was not con- 
sidered very valuable and Edsel is popular only with children. The 
viewers would like more on the show for men, more details pertaining 
to farming, more about Wisconsin (e.g.. Green County, summer vacation 
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spots,) some short-cut hints on sewing and cleaning, and more music 
for relaxation and entertainment. Many people would like to learn 
about "nutrition for children and losing weight for old people." 
It was also suggested that some recipes be aimed at younger people 
to teach teenagers to prepare food for the family. 
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INTERNAL EVALUATION 



RFD TELEPHONE SURVEY REPORT - TARGET POPULATION 




Early in the Fall of 1970 the RFD Staff approached communit)' 
leaders and social service agencies to develop a list of potential 
RFD participants. From this list of approximately 350 people, 
individuals were randomly selected for telephone interviews. 

Of sixty people selected from the target population for tele- 
phone questioning about the 16th TV program, fifty -nine were contacted. 
Four people (male) had no opinion to give because they had not seen 
enough of the program or simply did not want to give an opinion. The 
most impressive finding was that forty-one (eleven female, thirty 
malej had not seen the show at all. 

Six people (three female, three male), however, had watched the 
RFD program. Their ages ranged from thirty-eight to fifty-three 
years, with a mean age of 46.4 years. Four of these people had com- 
pleted the eighth grade, one had completed the seventh grade, and one 
had completed high school. The response to the mail survey question 
was four "yes" and two "no." Only one person said she had seen the 
show the previous week although four (two female, two male) indicated 
that they watched regularly. Another person said he tried to watch 
RFD "often," and the last said she watched "occasionally." 

There was some dislike of Edsel and a criticism of the suggestions 
pertaining to money. People were offended by the belittling attitude. 
In general, all six people liked the program. Specific appreciation 
of Jim Mader, Wisconsin history, and the interviews with "stars" was 
ment ioned. 

Suggested changes in the show were to have more recipes, music* 
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BEST COPY AVAIIABLE 

self -help, hints and suggestions, demonstrations for self -improvement, 
projects to improve family life, something on community development, 
and to cover fewer topics at a slower pace. 
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INTERNAL EVALUATION 

RFD TELEPHONE SURVEY REPORT - RANDOM SELECTION 
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After 17 programs, in May of 1971, a telephone survey was 
made to elicit opinions of the RFD television program. Every tenth 
number from the 924 (Bameveld, Ridgeway) and 935 (Dodgeville) 
exchanges of the Iowa County telephone book was called. From a 
total of 108 persons called, the frequency of response was as follows: 

Have you ever watched RFD? 
NO ANSWER 

(not home, line busy, line disconnected) 29 



No, not interested 4 

No, but interested 1 

No, never heard or read of RFD 2 

No, but has heard or read of it 5 

No, does not get Channel 21 2 

No, does not have a TV 1 

No 44 

TOTAL NO 88 

TOTAL YES 20 

How often have you watched RFD? 

All the time 3 

Very often 3 

Three or four times 9 

A couple of times 4 
(One person did not answer this question) 

Do you think it is a good program? 

Excellent 3 

Good 13 

Fai r 4 

Poor 0 
Er|c 160 
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What did you like best? 

Recipes 7 

General tone, infonaality, variety 6 

Household hints 6 

History of Wisconsin 3 

Interviews 3 

Farm suggestions 2 

Jim Mader 1 

Shirley Young 1 

Household management 1 

What did you like least? 

No complaints 16 

Puppet 2 

Interviews 2 

Age; Ranged from 23 to 76 years 
Average age: 49.2 years 



Five people did not give their age, but three of these were 
judged by the interviewer to be "very old." This would make 
the average age somewhat higher than 49.2. 

Last grade completed in school: 8th grade 7 

High school 9 
No answer 4 

General comments: just good, anything I don»t like, I turn off. 

Generally very good educational. Whiole thing 
is interesting, real good the way it is. 
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INTERNAL EVALUATI(»I 

TELEPHONE SURVEYS 
CONDUCTED BY THE WISCONSIN SURVEY RESEARCH LABORATORY 
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Wisconsin Survey Research Lab Report on the RFD TV Program 



During the first, tenth, and fifteenth weeks of the RFD tele- 
vision show, the Wisconsin Survey Research Laboratory conducted 
telephone surveys to ascertain audience characteristics and response. 
Two surveys were devoted exclusively to RFD. The third was part 
of a survey on Channel 21 programming. 

Surveys conducted during the program»s first and tenth week 
used identical procedures. Calls were made during the RFD telecast 
on four different days of the week. At these times the program was 
competing for viewers with three commercial television stations. 

Data for the first week of the RFD show are in three parts 
urban, rural, and combined urban-rural populations. Data for the 
tenth week are combined. The selection probability (sampling rate) 
for the urban population was half that for the rural population. 
Percentage estimates for the entire (rural and urban) Madison area 
(^c) were made by doubling the percentage for the population (^u) , 
adding the percentage for the rural population (^r) and dividing it 
all by three. 

2Pu 4- Pr « Pc 
3 

First Week Data 

Data from the first week's survey indicate the total numbers 
of persons watching television and those watching RFD by age and 
rural and urban residence. 
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Interviewers called 2,226 homes ---426 rural and 1,800 urban. 
In rural homes, 28.8 percent of the respondents had at least one 
television set on, and 7.3 percent of those were watching RFD. In 
urban homes, 25.5 percent had at least one television set on, and 
8.7 percent of those were watching RFD. 

These percentages are remarkably high, considering that the 
calls were made during all four programs and that RFD was competing 
with three commerical networks. It is probably unrealistic to assume 
that the RFD viewers on each of the four days did not overlap, but 
if this assumption is made, 26.1 percent of the rural viewers and 
27.6 percent of the urban viewers watched RFD one time during the 
week . 

Ages of the 6 7 persons in 48 households who were watching RFD 
during its first week survey also are summarized. Fifty-one (51) 
of the 67 were over age 18. 

Tenth Week Data 

The rtMth week survey followed the same procedure as that of 
the first week. Data presented here exclude age and urban -rural 
separation. 

Interviewers called 2,080 homes. Of these, 25.6 percent had 
a television set on, and 6.6. percent of those were watchinjj RFD. 
Those who were watching RFD were asked how often they watched the 
program; all said at least once a week. Of those who did not have 
a television set on, 25.0 percent said they or someone in their 
family had seen RFD, and 30 percent of these respondents said they 

saw it at least once a week. Jg-J 
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Fifteenth Week Data 

In the fifteenth week survey, 505 respondents were asked 
questions about Channel 21 »s programming, several of which dealt 
with RFD. A total of 118 respondents, or 23.3 percent, said they 
had seen RFD. Of these, 14.4 percent thought the programs were 
"excellent," 69.5 percent "good," and 13.6 percent "fair." No 
one indicated they were "poor." 

Discussion of Results 

During the first week, 426 rural homes and 1,800 urban homes 
were called while RFD was on the air. In the rural homes, 28.8 
percent had at least one television set on and 7.3 percent of these 
were watching RFD. In the urban homes, 25.5 percent of the homes 
had at least one television set on and 8.7 percent of these were 
watching Channel 21. Considering that the calls were made during 
all four programs, when RFD was competing against four different 
programs on other channels, the percentages are remarkably high 
for a program of this type. If we assume that the RFD viewers 
on each of the four days were totally different people and that 
the viewers of the other channels were the same people, then J4.U 
percent of the rural viewers and 27.6 percent of the urban viewers 
were watching Channel 21. The assumptions required for this last 
statement are, of course, unrealistic, and on the high side but 
the conclusion shows the effect of having multiple broadcasts.* 



* Combining viewership of both rural and urban homes, 2,226 random 
calls were made. Of these, 26.1 percent had at least one television 
set on and 8.4 percent of these were watching Channel 21 while KFD 
was on the air. Considering the multiple broadcast effect, 26.5 
percent jf the sets in use were tuned to RFD during the week. 
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BEST COnr AVAILABLE '^^^ 

During the tenth week» 2,080 hones were called. Of these 
25.6 percent had a television on and 2.1 percent of these were 
watching Channel 21. Considering the multiple broadcast effect, 
8.3 percent were watching Channel 21 while RFD was on the air. 
Those who were watching Channel 21 were asked how often they watched 
RFl) and all said once a week or more. Of those who did not have a 
television on, 25.6 percent said that they or someone in their 
family had seen RFD at least once. Of those who had seen at least 
one program, 30 percent said they saw it once a week or more. 

In the Madison Vote-In survey administered during the fifteenth 
week of RFD broadcasts 505 respondents were asked a number of 
questions about Channel 21 programming. Asked if they had seen any 
of the RFD programs, 23.3 percent said they had. Those who had 
seen RFD programs were asked if they were "excellent," "good," 
"fair," or "poor." 14.4 percent said "excellent," 69.5 percent 
said "good," 13.6 percent said "fair," no one said "poor," and 
2.5 percent did not respond to the question. 83.9 percent 
indicated the program was "good" or "excellent." 
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RFD TV PROGRAM SURVEY 
FIRST WEEK 

Q 1. I»m with the Survey Research Lab and we*re doing a TV study. 
Do you have a TV set on, now? 





Rural 


Urban 




Rural 
Urban 






N 


1 


N 


1 




N 


% 


Yes 


123 


28.8 


460 


25.5 




583 


26.1 


No 


145 


34.0 


620 


34.4 




765 


34.3 


No TV set 


1 


.2 


24 


1.3 




25 


1.1 


No answer 


157 


36.8 


696 


38.6 




853 


38.3 


Totals 


426 


100.0 


1,800 


100.0 


2 


,226 : 


LOO .0 


4 many people from your household are watching? 




None 


Rural 
N 1 
8 1.8 


Urban 
N % 
22 1.2 




Rural 
N 

30 


M mm m 

§ Urb 

^ ft 

1 . 3 


One 


46 


10.7 


192 


10.6 




238 


10 .6 


Two 


35 


8.2 


142 


7.8 




177 


7 .9 


Three 


22 


S.l 


46 


2.5 




68 


3.0 


Four 


8 


1.8 


34 


1.8 




42 


1.8 


Five 


3 


.7 


12 


•6 




15 


.6 


Six 


0 


.0 


6 


.3 




6 


.2 


Seven or more 


0 


.0 


4 


.2 




4 


.1 


Inappropriate 


303 


71.1 


1,340 


74.4 


1 


,643 


73.8 


Not Ascertained 


1 


.2 


2 


.1 




3 


.1 


Totals 


426 


100.0 


1,800 


100.0 


2 


,226 


100.0 
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3. What Channel is it tuned to? (set No. 1) 





Rural 


Urban 


Rural 
Urban 


c 

Q 




N 


% 


N 


1 


N 


1 


Channel 3 (CBS) 


44 


10.3 


188 


10.4 


.232 


10.4 


Channel 15 (NBC) 


24 


5.6 


118 


6.5 


142 


6.3 


.Channel 21 (WHA) 


8 


1.8 


40 


2.2 


48 


2.1 


Channel 27 (ABC) 


34 


7.9 


108 


6.0 


142 


6.3 


Channel 13 


7 


1.6 


0 


.0 


7 


.3 


Inappropriate 


303 


71.1 


1,340 


74.4 


1,643 


73.8 


ascertsmeci 


6 


1.4 


6 


.3 


12 


.5 


1 oral 


426 


100.0 


1,800 


100.0 


2,226 100.0 


What Channel is it 


tuned 
Rural 


to? (set No. 2) 
Urban 




Rural 
Urban 






N 


% 


N 


% 


N 


% 


Channel 3 (CBS) 


2 


.4 


0 


.0 


2 


.0 


Channel 15 (NBC) 


U 


.0 


2 


#1 


2 


.0 


Channel 21 (WHA) 


X 


.2 


0 


.0 


1 


.0 


Channel 2 7 (ABC) 


0 


.0 


4 


.2 


4 


.1 


Channel 13 


0 


.0 


0 


.0 


0 


.0 


Inappropriate 


422 


99.0 


1,792 


99.5 


2,214 


99.4 


Not ascertained 


1 


.2 


2 


.1 


3 


.1 


Total 


426 


100.0 


1,800 


100.0 


2,226 100.0 
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Q 4.. Could you tell me the approximate age (s) of those from 
your household who are watching? (all persons, all sets) 





Rural 


Urban 




Rural § Urban 




N 


% 


N 


% 


N 


% 


Less than 16 years 


100 


42.6 


310 


36 .1 


410 


38 .4 


16-25 


31 


13.2 


170 


19 .8 


201 


18.4 


26 -35 


21 


8.9 


106 


12 .4 


127 


11.6 


3o -45 




6.0 


58 


6.8 


1 L 


0 • 0 


46-55 


17 


7.2 


72 


8.4 


89 


8.1 


56-65 


21 


8.9 


60 


7.1 


81 


7.4 


66 and older 


24 


10.2 


42 


4.9 


66 


6.0 


Not ascertained 


7 


3.0 


40 


4.6 


47 


4.2 


Total 


235 


100.0 


858 100.0 1, 


093 


100.0 


from Q 2 § Q 4 for 


those 


individuals, both rural 


and 


urban , 



who were watching caiannel 21 (N « 48) follow: 

Q 2. How many people from your household are watching? 

Rural and Urban 



N % 

One 32 66.6 

Two 11 22.9 

Three 3 6.2 

Four 2 4.1 

Total 48 100.0 
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Q 4. Could you tell me the approximate age(s) of those from 
your household who are watching? (all persons) 

Rural and Urban 





N 


% 


Less than 16 years 


13 


18.3 


16-25 


8 


11.3 


26-35 


17 


23.9 


36-45 


8 


18.3 


46-55 


3 


4.2 


56-65 


7 


9.8 


66 and older 


11 


15.5 


Not ascertained 


_± 


5.6 


Total 


71 


?00.0 



RFD TV PROGRAM SURVEY 
TENTH WEEK 

Q 1. I'm with the Survey Research Lab and we're doing a TV 



Do you have a TV set on. 


now? 






N 


% 


Yes 


533 


25.6 




No 


649 


31.2 




No television set 


14 


.6 


No answer 


884 


42.5 


Total 


2,080 


100.0 


170 







Q lA. Has anyone in your household ever watched the 



RFD program? 

N ^ 

j Yes 166^ 25.0 

No 444 67.0 

Oon*t know 46 6.9 

Not ascertained 7 l .1 

Total 663 100.0 
Q IB. About how often? 

N t 

Once a week or more 49 29.5 

Three tiroes a month 2 1.2 

Twice a month 17 10.2 

Once a month 11 6.6 

Less than once a month 83 50.0 

Not ascertained 4 2.4 

Total 166 100.0 
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Q 2. How many people from your household are watching? 









A, 




iMone 




1 .4 




une 


O A O 

248 


11.9 




iwo 


174 


8.3 




Three 


A O 

48 


2.3 




Four 


14 


.6 




Five 


lU 


• 4 




Six 


2 


• U 


Inappropriate 


1,546 


74 .3 


Not ascertained 


8 


• 3 


Total 


2,080 


inn n 


Channel or program is being watched? 


(set No. ] 






N 






Channel 


3 (CBS) 228 


10 .9 




Channel 


15 (NBC) 122 


5 • o 




Channel 


21(WHA) 11 


.5 




Channel 


27 (ABC) 144 


6.9 




Channel 


13 1 


.0 


Inappropriate 


1,546 


74.3 


Not ascertained 


28 


1.3 


Total 


2,080 


100.0 
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What Channel or program is being watched? (set No. 2) 



Channel 3 (CBS) 
Channel 15 (NBC) 



N 
1 
0 



Channel 21 (WHA) 
Channel 27 (ABC) 
Channel 13 

Inappropriate 

j 

' Not ascertained 
Total 



.0 
.0 

.•0 i 



2 
0 

2,062 

15 

2,080 



.0 
.0 
99.1 

.J_ 

100.0 



Q 3 A. About how often does someone in your 
household watch the RFD program 



N 



About once a week or more 



Inappropriate 
Not ascertained 
Total 



11 
2,057 

IJ^ 

2,080 



.5 
98.8 

^ 

100.0 
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Q 3B. Has anyone in your household ever watched 
the RPD program? 





N 


% 


J Yes 


" 139 * 


6.6 




00 / 




Don't know 


34 


1.6 


Inappropriate 1 


,557 


74.8 


Not ascertained 


13 


0.6 


Total 2 


,080 


100.0 


Q 3C. About how often? 


N 


% 


Once a week or more 


59 


42.4 


Three times a month 


6 


4.3 


Twice a month 


5 


3.6 


Once a month 


20 


14.4 


Less than once a month 


48 


34.5 


Not ascertained 


1 


0.9 


Total 


139 


100.0 


tell me the exact ageCs) 


of those 


from your 



household who are watching Channel 

All persons, 
Channel 21 



All persons , 

all other channels 



o 
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N 


%* 


N 




16 years 


5 


0.6 


294 


36.2 


16-25 


6 


0.7 


142 


17.5 


26-35 


0 


0.0 


116 


14.3 


36-45 


0 


0.0 


54 


6.6 


46-55 


1 


0.1 


70 


8.6 


56-65 


3 


0.4 


62 


7.6 


older 


3 


0.4 


57 


7.0 


Total 


18 


2.2 


795 


97.8 



I of all persons watching any chani^'el 
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RFD TV PROGRAM SURVEY - FIFTEENTH WEEK 

Q 5. Channel 21 frequently repeats showings of programs on alter- 
nate viewing times. Do you feel this is done too much? That 
it is a good idea as is? Or that it should be done more often? 





N 


«t 


Too much 


28 


5.5 


Good as is 


243 


48.1 


More often 


21 


4.1 


Don't know 


105 


20.7 


Inappropriate 


108 


21.3 


Not ascertained 


0 


0.0 


Total 


505 


100.0 



Q 6. Have you seen any of the programs on the channel 21 RFD series? 

N 



118 



269 
10 
108 
0 



2 3.3 ( 
53.2 
1.9 
21.3 
0.0 



No 

Don't know 
Inappropriate 
Not ascertained 

Total 505 100.0 

Q 6 A. In your opinion, were the RFD programs you saw 
excellent, good, fair or poor? 

N % 



Excellent 
Good 
Fair 
Poor 
Not ascertained 
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Total 



17 
82 
16 
0 

3 

118 



14.4 
69.5 
1 3.6 
0.0 
2.5 

100.0 
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INTERNAL EVALUATION 




PARTICIPANT SELECTION FOR THE EXPERIMENTAL TREATMENT 

AND CONTROL GROUPS 
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Participants for the treatment and control groups were 
identified by the field staff. Working as teams within their 
counties, the three supervisors and eight home visitors began 
the process in early September, 1970. three assumptions were 
made in the design of the recruitment process. First, that 
leadership exists at all levels of society. Second, that 
leadership at the more visible levels will, if requested, direct 
one to leadership at less visible levels, and third, that leader- 
ship for the participant in the treatment and control groups 
would be relatively invisible in the community. 

Beginning with county officials and agency supervisors, 
the field staff sought the names of individuals who might be 
included in the treatment and control pool. When an individual 
living in the four county primary target area who seemed to 

« 

have the potential for inclusion was discovered, he was con- 
tacted by a member of the field staff. The first task was to- 
attempt to assess the extent to which the individual met the 
criteria of willingness to participate and formal education. 
The field staff also assessed general need in the potential 
participant, for the acquisition of the coping skills contained 
in the RFD Content Centers. An interview by phone or in person 
was arranged in which basic demographic data were secured 
(see sample form, page 174) , 

On December 29, 1970 the field staff met and by county 
teams sorted the information forms of all of the potential 
participants from their counties. They were placed in a 
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three -part rank order of the extent to which individual, in 
the judgment of the county team, had need for the acquisition 
of coping skills through the services of a home visitor. The 
instructions to the field staff stated that need was to be 
defined in terms of the gap between their present situation 
and some more highly desirable level of performance and the 
potential for the candidate to profit from the services of the 
home visitor. 

The rank order of candidates in each county was then 
screened by the associate director for field services to assure 
compliance with the criteria for selection. From the remaining 
candidates 100 individuals were accepted in the order in which 
their names appeared in the rank ordering for inclusion in the 
final treatment -control pool by counties. 

Dane County --36 individuals 

Green County --28 individuals 

Iowa-Lafayette Counties - 36 individuals 

Through random selection, one half of the individuals in 
')ach of the county groups were then assigned to treatment and 
che other half to control. The county supervisors were then 
informed of the individuals in their respective counties 
assigned to treatment and they in turn assigned these individ- 
uals to home visitors. This final assignment was made with 
some consideration given to travel distances between the 
residences of home visitor and participant in an effort to 
reduce travel time and expense for the home visitor. 

J 78 
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R F D 

Would you like to become a metiber of AFD? 
We would like to know some things about you. 



What is your name? 



What is your mailing. address? 



(city) • C*ip code; 

What is your telephone number? ( ) 

Are you a man , or a woman ? How old are you? 

(years; 

What are the directions to reach your house by car? 



How many years of school have you completed? 

(years) 

Our communities have many agencies that help people make a better 
life for themselves. These agencies may provide medical secvices 
when we are sick» help us to buy food and clothing when we have 
no money, help us to find a job or to learn how to do a better 
job of farming or homemaking. At the present time are you being 
helped by any people or agencies in your community? 

Agency Kind of service 



What is the best time to visit you in your home?.^ on 

(hours) (days) 

Do you have a TV set? Can you receive (Hiannel 21? 



You have already told us much about yourself. Is there anything 
else you think might be useful for us to know? 
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INTERNAL EVALUATION 

DEVELOPMENT OF EVALUATION INSTRUMENTS 
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Development of Evaluation Instruments 

A major concern of the RFD evaluation program has been 
to devise adult -oriented instruments for the measurement of 
change. It was desired (see RFD First Year Report, Evaluation 
Design, pp. 6-11) that evaluation of the RFD program have the 
following instruments: 

1) An achievement instrument 

2) Internal-External construct instrument 
5) An attitude change instrument 

4) An Instrumoiit to mottHuru ch.ingo In bohiivlur 
The rationale for developing these instruments is ilusc l ibcul 
in the next section of this report, "Consideration on the 
Construction of an Adult Achievement Test," For convenience in 
further references, these instruments are named as follows: 
1} The Wisconsin Test of Adult Basic Education (WITABE) 
for the achievement instrument 

2) Wisconsin Adult Attitude Inventory (WIAAI) , Part I 
for the internal -external construct instrument 

3) Wisconsin Adult Attitude Inventory (WIAAI), Part II 
for the attitude towards education instrument 

4) The World About Me for change in behavior instrument 

The following description delineates the various stages under- 
gone in developing final instruments of desired psychometric 
characteristics. It also describes the administration and 
scoring procedures of the test. 

Wisconsin Test of Adult Basic Education (WITABE) - This is a 
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test especially tailored to monitor the attainment of basic 
educational and coping skill behaviors, by the enrolled members 
in the RFD field testing program. In developing WITABE, besides 
taking into consideration the design of the RFD program, attempt 
was made to fully incorporate in testing the basic philosophy 
of the program as well. It has been emphasized that "the goal 
of the program is not to subject adults to ways that fulfilled 
only good pedagogical techniques; rather allow our adults to 
fulfill other basic practical needs - the RFD program is not 
9 literacy program, instead, it is a program that provides 
strategies of who to see, where to go, and what to do.*' The 
RFD program has essentially capitalized on adult learners' 
in,terest in a selection of relevant coping strategies. The 
design has been appropriately called a "three track system." 
Taking analogy from a subway train, they state "... the center 
track ot the *hot track' would carry the coping skills, the 
two outside tracks of communication and computation skills would 
provide the stability in learning methods and mechanics." 
(RFD First Year Report, June 1970, Part II, p. 25) 

Consistent with the objectives and structure of the RFD 
program, the WITABE is divided into 3 subtests. Subtest 1 and 2 
deal with basic reading and computational skills, respectively. 
Subtest 3 deals with coping skills consisting of practical 
problems an adult normally faces in his day-to-day work. This 
later subtest is designed to measure an adult-achievement- 
construct requiring the basic application of reading and compu- 
tational skills plus a maturity of seeing through life problems. 
It is believed that this comes about by having the essence 
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o£ information needed by our society and having the capacity to 
use it in appropriate situations. 

The coping skill subtest is parallel to the "hot track" of the 
program design, and it is in fact the heart of the achievement in- 
strument. It consists of various measures of adult -oriented problems 
put in an unconventional testing mode - more as fun-to-do tasks. They 
are designed to motivate the examinee with their form of presentation, 
fheir meaningfulness in real life, and testing each behavior from the 
lowest level of sophistication to several higher levels, so that an 
examinee is not frustrated and embarrassed due to his inability to 
respond to an item. It is hoped that in this endeavor we have met to 
a sufficient degree the challenge of the test critics in the field 
of adult basic education, who time and again have objected to the use 
of conventional test items. The 'nain objections raised by them for 
cho use of standardized tests like Lorge-lhomdike and Iowa tests 
have been that the content was not adult -oriented, the format appeared 
childish and more geared to testing school-like pedagogy, and often 
difficult to administer by paraprofessionals . Some of these objec- 
tions have been overcome in various degrees in recently developed 
standardized tests, like ABLE and TABE, but even these are still 
unlike the tests that experts in the field, as well as the subjects 
to be tested, would like. 

The WITABE in appearance ha#dly looks like a test booklet meant 
for children. We have avoided complexity at all stages and kept the 
appearance and the answer mode as simple as possible. All questions 
arc to be answered in the test booklet itself. No ambiguity has 
been reported with the items in the final trial instrument. With 
regard to content orientation, we believe that it is not adequate to 
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have only test items with content of family budgeting, bank interest 
and application for a job. Rather, as far as possible, it is necessary 
to provide situations which an adult faces in life. To this end, we 
have TV program listings, sale ads, job vacancy columns from the news- 
papers, as our subject would normally see them, and then asked mean- 
ingful queiuions. Similar strategy has been adopted in items on tax 
returns, filling a form for mail order, figuring amounts indicated on 
a credit card, and the use of telephone directory. During our pre- 
testing of WITABE, we have been constantly encouraged with the reports 
of the examinees about the suitability of the format, choii-e t^f tost 
items, etc. It is informative to quote one of thr oxaminoos who 
reported that "I do not know much about some of the items in the last 
part, but these are actually some of the things I should have known." 

In view of the precise nature of the information required, sub- 
tests 1 and 2 are in more conventional multiple choice format. While 
subtest 3 is the longest in testing time, subtests 1 and 2 are much 
shorter and relatively much easier. These subtests (1 and 2) ire 
printed in bold letters, with sufficient spacing between the lines 
to keep the test form simple in appearance. At no place does it 
require undue sophistication of perceptual organization, or fine 
motor skills. The problems are concrete rather than abstract, in 
consonance with the cognitive style among the functionally illiterate 
adults . 

Content selection and pretesting - Selection of the test content 
was based on the transitional behavior objectives of the RFD pro- 
gram, (see RFD, First Year Report: Part IX) 



184 



-180- 

The transitional behaviors were specified by the associate project 
director for research and development. If the test item is con- 
structed to measure those behaviors, the instrument will be self- 
validated. In selecting items, a correlation of each item with 
the total test score will be a good index of item validity co- 
efficients. To begin with, a much larger number of items were 
constructed on each subtest. The trial instrument was adidinistered 
to 120 school subjects from grades 6, 7 and 8 of a rural Wisconsin 
public school. The purpose was to find the internal consistency 
coefficient, difficulty index, discriminative index and the validity 
index of each item, by subjecting the test data to an item analysis. 
A critical scrutiny by the members of the Psychometric Laboratory 
led to rejection of some of the unsuitable items and modifying a 
few others which did not come up to desired statistical criteria. 
This has been one of the important phases in the development of all 
the instruments which required several group sessions. A modified 
instrument was administered to 37 subjects - 22 being the students 
enrolled in adult-basic education classes in Fond du Lac Technical 
Institute, 9 belonged to Head Start parent group at Mazomanie and 
.6 from Head Start parent group at Sun Prairie. The test data 
revealed that the items approached a high degree of psychometric 
quality. Some of the items were again modified in the third and 
final instrument. 

Thp GITAP output gave the difficulty level, item criterion 
correlation, and discrimination index data. In choosing the items, 
we were quite stringent with the item test correlation and 
Beta, another discrimination index. None of the accepted 
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items has an item- test correlation of less than 0.5 and a discrimina 
tion index of 0.6. For the difficulty index, we abandoned the 
usual rule of thumb of choosing an item of 50 per cent level of 
difficulty to obtain optimum reliability coefficient. To motivate 
the subjects and to give a good start in testing we have gone at 
times up to 5% difficulty level at the lower end. A 15% to 20^. dif- 
ficulty level will be found quite usual in this instrument. 

The Hoyt reliability indices and the testing time for each sub- 
test are as follows: 

Subtest No. of Items Testing Time Hoyt Re 1 1 ability 

Verbal 20 15 minutes 0.90 

Numerical 19 30 minutes 0.88 

Coping Skills 29 45 minutes 0.90 

TOTAL 68 1 hour, 30 minutes 0.96 

Following is a description of the items in each of the subtests. 

Verbal Subtest - It has 20 items in multiple choice format. Of the 
20 items, 9 are vocabulary items ranging in difficulty span from 1st 
grade to the 8th grade level. Four of the items require the examinee 
to arrange letters like K A L W into meaningful words. Anocher four 
items (14 to 17) test on the meaningful use of the dictionary and 
newspaper reading. The last three items (18-20) measure behaviors 
on the usage of the "Table of Content" in a book. The level of 
achievement needed to respond to these items is grade 6. The ques- 
tions are straightforward and do not involve any tricks. 

Numberical Subtest - The numerical subtest has 19 items in all which 
are in multiple choice format. Again, the aim is to test the basic 
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computational behaviors ranging in difficulty level equivalent to 
grade 2 through grade 8. The items are base4 on number recognition, 
knowledge of fractions, multiplication "fables , measure oi' arvnta and 
volumes like square feet and pints. Seven items (33-393 require the 
knowledge of arithmetic operations to solve adult-oriented prohloms 
dealing with life. 

Coping Skill Subtest - The coping skill subtest has 29 scorahlc 
items. This subtest attempts to make testing more fun, at xhc simv 
time it throws a challenge to examinees. The various phases of this 
subtest again have at least one or two items which couUl he .niswcMod 
by almost all the subjects. Most of the items make use of the news- 
paper and magazine ads with which an average adult of our concern is 
well familiar. Similarly, in measuring behaviors relating to use of 
a telephone directory, using a road map, ordering by mail, filling 
out an income tax return, and applying for a job, the format used 
is easy to follow, simple in the mode of responding, and satisfying 
to an adult subject in its content and presentation. 

Test Administration - The conditions of testing used in the pre- 
testing were very flexible, so that paraprofessionals adminis- 
tering the test would face no problems. The approximate time limits 
are indicated above and at the beginning of each subtest in the tost 
booklet, but the examinee can be allowed to work at his own pace. 
He is required to answer every question as far as possible. 'n»cre 
arc no special arrangements for beating, or reading out instructions 
except that the examinee be explained the meaning of certain words 
which form the part of the instruction in a question w'.thout giving 
any clue to the problem. 
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Scoring - 

In subtests 1 and 2, the subject scores 1 point for each correct response 
and no points for the incorrect response or no response. In sub- 
test 3, the examinee scores 1 point for each correct part in items 
40, 41, 44, 45, 46, 47-50, 51, 53, 54. The key for the remaining 
items is: 

Item 42: 2 points for all correct 

1 point for 2 or 3 sub -parts correct 

0 for 1 or 0 sub -parts correct 

Item 43: 2 points for both sub -parts correct 

1 point for any one sub -part correct 

0 for none of the sub -parts correct 

Item 52: 2 points for all 3 sub -parts correct 

1 point for 2 or 1 sub -parts correct 

0 for none correct 

Item 55: 3 points for all sub -parts correct 

2 points for any 2 sub -parts correct 

1 point for 1 sub -part correct 

0 for none correct 

Item 56: 3 points for all sub -parts (including Column 31) 

correct 

2 points when 219 is entered in columns 19, 21, 
23, and 25 

1 point when only one 219 is entered 

0 for none correct 

Item 57: 3 points when examinee writes logically stating 

his qualifications with the following 

2 points when he makes a half-hearted case with 
the following 

1 point for basic letter writing format 
0 for blank or unmeaningful sentences. 

Wisconsin Adult Attitude Inventory (WIAAI) , Part I - The 
rationale for the development of an inventory measuring the sense 
of control over the environment is described in the RFD Hvaluation 
design, (see RFD, First Year Report, Part XVII, p. 11.) It has hccn 
noted that for the disadvantaged groups, sense of control or a lack 
of it is associated with academic achievement or the lack of it. 
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People who perceive their environment to be predictably responsive 
to their efforts tend to attain higher academic achievement than do 
people who perceive their environment to be arbitrary. 

WIAAI is an instrument which has been tailor made for the a<iu 1 1 
population similar to those in the RFD program. A much larger pool 
of items was constructed and subjected to pretest. The first tria! 
instrument was administered to students from a public school system 
in Wisconsin and the final trial instrument was pretested with a 
group composed of Head Start parents and students enrolled in 
Adult Basic Education classes at Fond du Lac Technical Institute, 
Fond du Lac, Wisconsin. This group of subjects was the same as that 
pretesting WITABB. Before arriving at the decision to include the 
final statements in the instrument an item analysis and RAVH Analysis 
was done on the data collected. The purpose of item analysis is to 
look for desirable psychometric characteristics in the items and weed 
out or modify those items which do not come up to desirable psycho- 
metric standard. The purpose of the RAVE analysis is to judge the 
suitability of the weighting scheme. The attempt is to weigh the 
"desirable" response by a large number and "undesirable" response by a 
small number, so that the person having, say, considerable amount 
of this trait receives a high numerical score and the one having 
less receives a low score. 

The instrument in its final form has 16 items. The responses 
are to be made on a five point scale. The Hoyt reliability indicat- 
ing the internal consistency for 16 items with the group described 
above was found to be 0.55. 
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The Wisconsin Adult Attitude Inventory (WIAAI) , Part H - 
This instrument has been developed to measure the attitude of atluUs 
towards education. In its final form it consists of 23 statements 
requiring responses on a five point scale. TTie psychometric part for 
developing this instrument was the same as WIAAI, Part 1. The Uoyt 
reliability coefficient for 23 items tested on the same group of 
subjects as WIAAI, Part I was found to be 0.84. 

Administration of WIAAI, Parts I and II, takes about 25 minutes. 
The subjects need not adhere to the above time limit, rather they may 
be allowed to respond at their own pace without taking undue time in 
answering the items. Hie instructions given to the subject arc printed 
at the beginning of this subtest and can be further explained by the 
test administrator if a subject so desires. 

The World About Me - This is an instrument which has been devel- 
oped to measure actual behaviors of the RFD clients. The procedure 
for developing this instrument has been the same as with the WIAAI in- 
strument. The aim here has been to look for items which can give maxi- 
mum information regarding the actual behaviors possessed by the subjects. 

In its final form "The World About Me" consists of 20 items. The 
responses are to be made on a three point scale. The format is very 
simple to understand and the statements are typed with sufficient 
spacing. The reliability coefficient giving the internal consistency 
of 20 items with the same group as in the above two instruments has 
been estimated tc be 0.92. The administration of this instrument takes 
about 5-7 minutes. 
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RURAL FAMILY DEVELOPMENT 

Please tell us about yourself: 

Your name 
Address 

Are you a man or a woman 



WHA TVlg 21. UNIVERSITY EXTENSION, Th« Univwtity of Wiwonsin 
C(H>yriflht (c) 1971 by The Boiird of Ragnnts. The Univeriity of Wisconsin 



ERIC 



J 91 



THIS THST IS DIVIOBD INTO IHE FOLLOWING 4 PARTS 

PART 1. WORD MEANING, READING 

PART 2. ARIT»(BriC 

PART 3. LIFE COPING SKILLS 

PART 4. THE WORLD ABOUT MB 



Many of the questions are easy* 

Sone questions look hard. 
Birr if you will read it line by line you will find it fun to do. 



O.K., Now start with Part 1. 
It will take you about IS minutes. 
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for Mdi of the words on the left, diedc the word that means the same. 



1. mm 



give 
let 

follow 
leave 



2. START 



read/ 
go 

begin 
stop 



3. OONCBMI 



clear 
blame 
honor 
tiy 



4. DENSELY 



sparsely 
diffusely 
recently 
thickly 



5. n 



operation 
advancement 
possession 
procession 



6. GONSISIBir 



dianging 
correct 
untrue 
uivar/ing 



o 
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7* tSTBBH 



pay 

pressure 
disdain 



8. SU9MISSIVB 



elastic 
docile 
conpetitlva 
oontraxy 



9. PRDFICZENGT 



deficiency 
skill 
tricky 
ind>ilit> 



ARRANQB THE LBTrSRS mO MEANINGFUL WORDS: 
BWMPLB: B Y 0 BOY 

10. S 0 T P 

11. KALW 

12. E 0 M Y N 

13. E 0 P N H 



f!S ?2'?*.>?IS,l?iiS^ "CK THE MHUITOAT IWXIU) BH LISTRT) 

lAST IN A DICriONARY, 

reliance 
mliglous 

relinquish 
reliable 



The guide mords portray and possible ^ipear at the top of the 
page in one dictionary. HSiich word would not be fbmd on that 
pa«e? — 



portrait 
positive 
position 
possessive 



A py^^face is fbind in what part of a book? 

before the table of contents 

rijjit after the table of contents 

in the first diapter 

in the sumaxy 

lihidi section of the newspaper has mostly opinions? 

the weather charts 

the lead news stoxy 
the editorial 

. the stock maiket reports 
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U)OK AT THE FOLlJGinNG TABLE OP COmmS AND FIND ITIB ANSWERS TO 
QUESTIONS 18, 19 and 20. 



Page 

1 
7 

15 
31 
45 



18. On ifhidi pag9 does "Beavers" begin? 

31 

45 

46 

19. Page 9 will tell is something about 

— — ^ nests 

wrens 

beavers 



TABLE OP amms 

Chi^ter 

1. A Bird*s Nest 

2. The Wrens 

3. Ihe Robins 

4. A Mole's Home 

5. Beavers 



20. Ihe stoiy of 'The Robins" is found on pages 

15 throujji 30 

15 througji 31 
31 throujji 44 
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Stretch your arms for 2 minutes if you wish 
and get ready for Part 2. 

These are problems in Arithnstic. 
This should take you about 30 minutes to answer. 
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MARK THE OORRBCT NW6RS. FOR SOMB» NONE OP TKB AhSMBRS m BE CORRECT. 



21. Nine hindnd and thirty five 

90.035 

9,035 

9,350 

935 

none 



22. Four thousand and ten 

4000,10 

40,010 

40,100 

4,010 

none 



23. Five eij^ts 

5 - 8 

5 + 8 

8/S 

.58 

none 



24. Hour would you read 120,001? 

twelve thousand one 

one thousand two hundred one 

one hundred two thousand one 

cxie huidred twenty thoisand one 
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2S« Sixt)r*nine dollars and two cents? 



$69.2 i 
$69.20 
$69.02 
69.02 
none 



26. Whidi of the following nunerals represents the greatest nuifcer? 



.307 
.730 



3.07 
3.7 



27. Write the nuii>er that is nine tines seven 



97 
907 
63 
49 



26. Nhich^ the figures belaid is one-third shaded? 






■ 









B c 

A 

B 



C 
D 
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29 « ISiich of these sets of coins has the greatest valiK^? 

1 quarter 
23 pennies 

4 nickels 
3 dimes 



30. Bob*8 nother made 4 quarts of lemonade. If Bob took 1 pint 
in his lixidi, hm much lemonade was left? 

7 pints 

11 pints 

15 pints 

^ 19 pints 



31. If 313 is rounded to the nearest ten» what is the resulting nunber? 



300 
310 
320 
400 



32. How many five cent stamps can you bi^r for a dollar? 



15 
20 
25 
30 
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33. Hie drcianfevoncc of a cirattnr pipe is 9 1/2 inches. 

Mhich of these is the best estimate of the pipe's diameter? 



1 1/2 indies 
3 indies 
19 indies 
30 indies 



34. Arthur boui^t a used car for $900. He paid $200 down and will 
pa)r the rest in 10 equal installments. How much will eadi 
psyment be? 



$55.00 
$90.00 
$70.00 
$20.00 



35. Si^Mse you earn $4000 a year from the sale of com and $2000 
from the sale of poultry. You spend $1?.00 in maintenance. What 
will your average income per month be in dollars? 



$100 
$300 
$400 
$600 
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36. A silo of IS foot In diantter nnU 40 feet hifih can store com 
froit SO acres of land. To doultlo the capacity of the silo, 
hour hi|h will it have to he if it has the sane diameter? 

60 feet 

65 feet 

70 feet 

80 feet 



37. A faim yard that is tOO feet x 50 feet is to be wire fenc)(cd. 
HSiat length of wire will be needed? 

250 feet 

300 feet 

350 feet 

400 feet 



38. In a room 10 feet long, 12 feet wide and 10 feet high, how 
many square feet of paper will be required for the walls? 

120 sq. feet 

240 sq. feet 

440 sq. feet 

1200 sq. feet 
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59« Joo has a savings accoiou that pays $% interest per yenr. IVIuit 
anoint will he receive after keepin|{ his $1^00 in the hmk 
for one year? 

$150S 
$1560 
$1575 
$1600 
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ffiST copy AWULABLE 

40. Ilciv U tJ\c T,V. in'OgViun sclunlulc for tonight. .ViwwiM- tho folUvinji 



A« What pTOgnon will be soon 
on channel 3 at 7:00 p.m.? 



B. 



If you switched on T.V. at 
6:4S p.m. which program 
would you watch on dhannel 
27? 



C. Itow long does the movie 
on channel 27 last? 




TONEOBr 



Mi 


H iJUiH 


l«4Mli or OooMfMiieai 


lf->ll0ffM 




ftW 




>"'DUIi»l BMKeiOMl 


illl 


n— minpui ncpvTt 


t— Wi1t> CNBUte 


f:N 




Sl-45tt FrandMO Mix 


« 'Mitiffourt 


IT—Mareus W«1lqf, M.O. 


l?-nck V« Dyke 


tttM 


fin 


lft~Ntwi, Wthr., Sporti 








If'^Kim, Wthr., Hpnriii 




Mill 


tt^Ntwt. f thr.. Sportt 


t~N8«s. wthr.. Sport! I 


ItM 


IS-Tontght i 


S-aimriy HUlbilliM 


»~I>iek Civett 


lft-4)0BKaollf 


UtU 


tl-Xttli. ma, onii 


•-News Hour 


f?-4iPd89Md 


ISiH 


Vtll 


lS-Ne«s 


$-Ck«ett Acres 


lt:ll 


tb-BwIkt I* 


l^Mejor Adams 


Ytll 


litis ' 




•-Tbe Ministers 



41. Here is a sale notice. Answer 
the following: 

A. Place of sale 



B. Date of sale 



C. Time of sale 
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THE jUlit^iU SALE 




Oct. 24, 1970 

DaM County Fairgrounds 

12:30 l>.M. 

19 httlH <*wt with <«lv«t at till*. S»fM«lMl 
•Mky IMT «rf Mm rittlMt hMiM . 
JOHN JOHN wMi •Nm4 iIm Ml*. 



6 angud farms 



DAVID SOLDWiDEL 

lOUTI a. STOUONTON. WISC. 



NOW SOME QUESTIONS ON LIFE COPING SKILLS 

This will take you about 40 minutes. 
Take a rest if you idsh and then coatinue. 
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42. IkM imidi do the following 
itom cost? 



8 ounces of cream cheese (Kraft) 



2 dozen lai^e eggs 



1 gallon orange juice 



Dairy Producls 



«M.aA.ouiiA«AUwiini 

l«r|tl||i 



cm. 



B^Hdl'^tt fig* ^\ 



tn 




CbMft %iS' 



4 S Here is a dipping from a 
newspaper. 

itaswer the folloidng qisstions : 



A. What does D.A. stand for? 



a A. Cttididates 

At tlMt ctadidatet tar dis- 
<IIiWet attoTMy to Dim Gbomy 
win ipMk «t tiic Uaivmiigr of 
WiMOMia Uw School PHdaj at 
2:30 p.m. Then will be a coffee 
Iwur at t:M pju. The nuinin 

room will be poitad to the 

«-«-«— 



B. What tine is coffee hour? 
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44. In the space belour write the teii|)erature 
shoMn on this theimometer. 



40- 



4S. Joe goes to sleep at 




p.n. He is going fishing 



tomormr and must get 19 at 



Exactly hoi much sleep will he get? 




in the morning. 



hours 



min* 



46. In the picture below how many indies longer is line seffnent 
b than line sepnent a? 
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Use the above table to answer the following. Do not allow 
for sales tax. 

47. What is the cost of 3 doubleburgers? 

32* 

96^ 

$1.06 

none 

48. Bd ordered a cheeseburger and French fries. Trudy ordered a hamburger 
and a cola. How much more did Ed pay for his lunch than Tnidy? 

lOi 

X m 

68* 

none 

49. Terry got a haii*)urger and an order of French fries. He gave Hank a 
dollar bill. How taich change did he receive? 

3U 

{)9* 

79* 

none 

50. Kir. Pnnm bought a cheeseburger for himself and one for each of the 3 
children riding in his car. How much did the cheeseburgers cost? 

544 

8U 

$1.08 

(^^ot given) 
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Sl. Mr. Tllman mcMwd this hill for amounts charfged on this 
Standard Oil credit card: 



i B^RW^BW ^ ^ ^ ^^^^^^^ 

ifl^qq 3#QQ 

1 MINICI dltWtl m t CMI9MI tlONMQC 

i«H«Bi»ia<>iilllitMittltlPi V tt.»f«miaCI _ 
i«av»Vl»ii«MiiiMittOMill / ^•UW 

•>Mt Ml t<«nt«r**» Milrtll Ml Mill 

„ MMIl KKOmiC MTI nm»cu^iJ,m^m^ 
12S IS 
MvnToniMi 

I 



nAHMfNt 

9M- 



• UU 



a.ou 



MIW4II MMl«%t • 



IS YOUR RAOIATGft PROTECTED? 
LET US CHECK YOUR ANTIFREEZE 




T 

A 



ft. Ill I 

VMHIl 



■ 4 • 



SAU3Y TIIMIVN 
120 H BRQMKAY 
BOX 84 

MOl^ WIS S3716 



T 

B 



J 



Answer the follonring questions : 



A. What anount will pay this bill in full 



B. If this amount is not paid this month, 
how mudi interest will be diarged on 
the anount of this bill? 



C. Which part of the bill (A or B shewn by 
artows) is to be returned with the piyment? 
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52. 



1} asiU'y - 

m 442ia|ltNli|MlA»U< 
4eSl«|ltHti|MsA#tt- 

tuififSwM** 

170*ll^port«r- 
SSNk Mil N 829 E floffiMii* 



•244.7 



'•fUSMAiMUict 244>l 

AftllirJ ai7 N Mar«Ntu444*! 



mMmCmi WaiUto- 
f9imfUm¥i9k4f 

iOlEifMdiray 
l4S9Atwooda¥ 




wbM (mi 

SlPmcii 
CMtir loei Unlrav- 



SI C trw al u Ji K L 4tOf HinHy i<-a»fltf? 
SlJMiiClivrck use Si Jmm cl-2S^S0« 
Si JiM CMMHliii raclM 

2a>ms stJaMMCMMMi im mmmi — 

StJo)MjMMtOMMai9SCwrtii.2SM9tS 

$1 Jo^w Rulpfc C ^ ^ ^ — 

7M Ea|l> HllfllU MU-2»>^ 



is:^ SlJota»eli«<g^JS10l«i|»lw»..244.S?»i 

VA*«yjf'?'S;H'l'i^JS! SUflmiMtlMfiT J7W MMW- 2574705 



C«fr«ll 251<0225 

wfVLntn^^ 

•271.4735 

2J 



Here is a portion of a page 
from the Telephone Directory 
of Eau .Claire, and belohr is a map 
giving Area Oodes. 



4401 MwirAl 

SI Jdins Emm K iiv 

im Sim9Mii..22M22S 
SI JolNi'iLntlitraiiCiMirtli 

M2EmMll«v-2S4-29SI 

SlJMpliaivrtfi 

mswStftliAtliy 271«S7n 

SI LoiNi 6la4i 1 ll** 

141 Oiimaii|-249>MU 

8iMH Pm 120 Unfdofi 
LMi$ RkM 440 HiwUitrw d- * -2SS-IW4 

« 9110 #lif cv 

* IMS OHbtrt ri 



m 



Write in the space below the ninber you 

dial to reach Mr. Ridiard M. Sale in Eau Claire* 



.2344413 
•235*1207 



S .2S7-J627 
-1 



0 [ 



HMJ CUVTRIi 

m u^m 

immhmC ins www to-rSIMm 
Sri^i UiiMr SiMt 

4*1* IM » MM4lMM"t34>S671 
SMMlKMNMriMl 

- . ^ iia4$Wh«m»W«..2n.flgJ 

«AMiiiMa If 2S Shmm iv24M(55 
SNMPoMOrdtfiltl ^.^^ 
110Elll4iii-2$7«ObM 

m MO Piralt Island rd 222«4IM 

SaiapilMMNiS 414 ClMOMn-- 2SM3SI 

Salailit limn Bviltr 296«0K5 

SElMlMha SOS H Cantil 296«74S2 

SiMar IMy 1920 Olrft Itr 2384408 

Salt AM 222S AIIM 4r ^^'^S 

MtlMi 1112 Spalafn 2Sl«2fSl 

San Mcfcari M aiO MtndoU cl- * - 2964S41 
SlMSaMM 

930 Eatit HtifMi Apli- -238-0247 

Sahm Ott 540 w oim av 25S-7S30 

Sakma 6aa V 409 CharlH la 23M788 

Sannia Jamas S 

22)4 Rastftbtrry rd •27t-$277 
SalMaSamS 370l Tuiaat av -•244«7103 
SilmaViia 2722 Willard av .•- •249«2S70 
Sain A Martoilaa Esacalivti Of Madisoa 

kK 3414 Maaraa • 23M5U 
SaltiSaMyoiOMffidatact • 256*8841 
Sanaa TiMlliy L aoo N. Ntnry 257.9196 
Sainviiil Win A Jf 

127 Lakcweod Gardrn la 241 •1024 
SaltMUWmFiDwtmtir -• 249-W02 
SlIiyAMil J )M S B.il(iwin • •■•23S-3K3 
Saity Itniartf 6 4210 Bifby i« • 249-7137 
Sally llMiaMMiht 

lakt Windier Wintft«r^Ot Frit ttt4^K»f 
Sally TllMaii24MEW«h«r ^^ •24M462 
SalliMMMJJr 

1204 6unUfl« Weed Way rd • •244*4824 

SalilliciiaDA ))« Pawlini 244-7M7 

SalllMwMn 2017 Jtnifer 244*0400 

SaNHCHuK 

904 £«9le H«i|M» Apt! 233^6O60 

SaMckJMtlm 912 suit 234*7411 

StfCkMMADrefc _ 
)M2At«eeda» 244*6390 
•h S714 Tenyawatha tr •• • 222*3463 

SliiCfc M Jaa 20) Marion 251*1223 

Wick RaMii 114 SNtnry 255*4497 

4lMMtD 

*4« Eafit NeitUti Apti -231 •2932 
' «}2WWilien- •.237*0374 
">73 Grtoo rd*233*28M 
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&3. tito this iwul nvir to WAnsr tho follcMins qtRnttidiis: 

N 




t 



Scale: 100 miles <• 1/2 inch 



1 



INTERSrATB HIOWAY 

U.S. Hif^a}r 
State Higlway 
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(A) About hm naiQr ndles is it from Brodkline to Boston? 



150 adles 
200 miles 
2S0 miles 
300 miles 



(B) tHhidi m^a/ would you take to go from Boston to Quincy^ 

93 North 

95 South 

3 South 



128 East 



(C) What direction Is Newton from Boston? 

East 

North-East 

West 

South 
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S4. 1116 gn|)h holtiw shoMK tho mrlier of Boflte ifiMlbod out ivm ttu* 
Lake Goint)r Bookmohlle during om yvart 

































— 




















— 




i 






















i 






















r 
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(A) Wiidi is the peak reading season? 

Winter 

Sunner 
Spring 
Fall 

(B) Hw any more books wexe checked out in Ai^st than in June? 

25 

50 

75 

100 

(0 Book ciXDilation increased for three straij^t months from: 

July to October 

Decenber to Mruary 

July to htovenber 

August to Noveober 

(D) Between which months was there the greatest decrease in the niiii>er 
of books chedced out? 

February and March 

April and May 

^^^.^^^ June and July 

hfovenber and Deoeaber 
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tmmmms. 



Suppose you are interDStod in purchasing 
this coffee percolator from a Soars 
catalogue and you would like it in the 
gold color. 




iSknvatdrWkiMlM- \\J 

VSrim Nppi Mill ^ 








Pill in the following nail order foim 
to receive your coffee percolator by 
Parcel Post. 


■ 


1 





SEARS, RORRUCK AND CO. 
Clikiifa.niiiwJi 60607 



Seais 



Oiitt 19 , 



M TISFACTION OUAttANrHKt) OH YOUR MONEY RACK 
niMt mm connm mivnv wrMaiATiofi 

■4 Mff to iriv« eompiM maillfii«Mr«t» at tht rifiht f ittmii \n th« eor * 




IMlSOit MtflAil 



CATAIMIiUttMII 


MOW 


NAMt or ITEM 




aiMMftlililINt 


u. VI.. ft. en 


TOTAL Mice 
OtRMi 1 Ccirtt 


t 












1 
















1 




i 












1 







lUlMOIS cusluinrrt Add Um for MCh dO(t«r of good's (4r $Uln. U city). 

IMINAIIil viittoiitrrt add 2c Um lor ooeh dollar of t*o<>d^. 

tOWA Of MISSOUM custom«ra add 3e Ua (or dach dollar of isooda. 

KIHTUCKV I uttoniors add Ua for aaeti dotscir of itoodt. 

MtCNMMMI, OHIO or WtSCOmiN cyatomora add 4c taa for oath dollar of (ioudi. 

H vw CMMiy Ni OHIO feM • tM. ladait ito aNtHaaal lu raaaif til . 

1 1« «ci«« aattfdM mianiiaiAii avetfaMi' at a^wKaa and •uoieci to <ii4iiixe. 

H«#iH4UWt«l|«l».rc.,l»«%MD*j 'i^rt^^^^^ ' ^^^tAVi 

i«i»roaarirfOi«ftt (Haitor rrucft) (J 1 4ati«arv «t«ire ti inili^i ceti SCRVICC 



%mfMiitia 



ivaut M aoi MiNi< 



TOTAL roK QOOOS 

<r AMOUMT rOII TAX 

It ciaot trill. ^ 

vaaMliaiaaal MtTAOt 
MiMiialiryaa 

A t waii t I OM Soara 



TOTAL CASH INUCI 



SHM. WT. 

IH. Oi 



tat«t f to Ji> 
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S(». 



Itere yoii art* ftivtMi a« iiKOiiiplcte TAX 
KinaiKN K)KH ami also a TAX TAlUJi, 

Use tho TAX TAHhl; to complete line 19 
of the TAX l<m. Then coniplete lines 
21, 23, 25, and 30 (or 31). 

llie TAX RHIURN VOm is for a warrled 
couple filing a joint return. 




tt WapibMiiiln.«MtM.(MMiNnMW-tttiMiuif 
U InlMMtlniwtiMliWiCilMlittiiiPMIioflcfMMtl, ftoW !••«•( $100) 

ifwwiw vnipf ^v^Mt WMwmMv WW wiwwt %ffwn miw ^vj • • • • • 

MTeUi(a«BimStiae»UwilS) 

^ KifniN HMhm tr MM 19 k f IO,O0Q tr mor«, f» to lhi«4« lo flgwrf tM. 
^' If TMfeMHIm:T«TillNl^)[(TMlMtMNtiXV,trZascfeMiBa«SdMii^ 

Mil* Tm SviQiMmi Tibtoi A> B Md C in liMtfiMlioM^ (If yw ctekn ivHvifiiMl 

ai Tom lait Iw It Hi lOi 



• • • • 



■ ■ ■ • 



r 




aiT«M«i«Ml(»Milfeit8D ^Wl'^' \^^J!Sf^- • ' • • 

MOttNTlMKAMilMtt) ^^^R^^L(f«i^- • • 

» Tom (aii iNM It Mi M) . . WwT T ... . . 

tt Tim rttmtt im iwii tm »aw wM (ifdi rowm w^a to mcm . . I tt i aaa^ i ac 



ti iaw wM (ifdi rofimW^a to tacit) . . JL, 
W« mmt m % mm • \M 

(hwi Im CB) •••••••• 

B Taw (tii Ihmlfc ty. awi » 





oo 




Q 




1 

14 


too 


00 


If 
SS 


. 0 






17 






It 






if. 
St 






0 




SI 








C 




St 






St 


0 




SB 







a33 \66 



ii 



SI H Mia tt k iaipr 
St Una tl la In (a) 



lMlt.anlartAUIICCOUE.NylnMlwHlii«lHm ^ 

at. anlar OVtSMYMfNT ^ 

an Xt71 aatmaM tai ^ t . (t) RaNniii ► 
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S7. Suppose that you are looking for a job. You see this aU in the 
iMMsiNver* 




This is just the kind of job that you want. Write a letter 
applying fbr the job. 



vent KB miR SCMB qUESTIONS ABOOT YOUR VIEWS ON VARIOUS METERS. 
This section will only tiike a few minutes. 



^16 
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R PO 
IHB NORLO ABOUT NB 



Here are seme <mestions that ask hon you feel about certain things. 
There is no right answer; we just want to know how you feel* 

If you think a statement is really ttw, and you really agree with it, 
put a circle around YES, 

Around here, it gets cold in the winter. ^ SS. 

If you think it is cold, but not very cold, circle yes. 

Around here, it gets cold in the winter. ]^ ^ ^ 

If you are not sure, circle ?. ^ 

Around here, it gets cold in the winter. YES yes no NO 
If you don*t think it gets cold, circle no. 

Around here, it gets cold in the winter. YE§. Y®* ^ iS. 
If you really don*t think that it gets cold, circle MO. 

Around here, it gets cold in the winter. YBS yes ? no [NO 
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PMpU Mho mk hard Mum big mngf. 



YBS y%$ 



Pwple i4k> mvk hard alwiys get ahead. YBS yes 



You should always be willing to adnit 
Mistakes. 

People get idiat they deserve. 

With ae, luck is pretty important. 

To get a good job, you have to be at the 
right place at tiie right tiae. 

There is not Mich that the little ginr 
can do about politics. 



If ywng people irark hasd, they idll 
do tuell. 



everythiflc I have I got by hard work. 



It doesn't matter idiat I do, I still 
have hard luck. 



People should live for today and let 
toBorroM take care of itself. 



Peq>le can actually do very little to 
change their lives. 



YES yes 

YBS yes 

YBS yes 

M yes 

YBS yes 



there is raally no sudi thing as luck. YBS yes 



YBS yes 



YES yes 



YES yes 



YES yes 



A prson who is mlly good can get a 

job aiiftim. YES ves 



-213. 

m 

no m 



no 

no 

no 



no 



no 



no 



no 



IjD 
NO 



no W 



NO 

NO 
NO 
NO 



no NO 



no NO 



no NO 



no NO 



In our country, people have control 
over idiat happsns to then. 



A person really has little control ww 
his own fate. 



YBS yes 



YES yes 



no NO 



no NO 
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If you get an education, you have a better 
dvuicc to do Mhat you want. Yl^ 



yes 



no Nl> 



Education gives you power. 



Just being educa t ed won't make people 
like you« 



YliS yes 



YBS yes 



Adults can*t find a place in the sd)ools<; yes 



The more you go to school the more you 
can figure things out. 



YES yes 



Schools teach you hour to get along with 

other people. ]ng yes 



Schools are really O.K. right now. 



Without schools, this country would 
go downhill. 



•YSS ye§ 



YES yes 



Teadiers don't really care about students. Yg, yes 

Education increases the hatreds that lead 

to wars. YES yes 



htost children don't seem to get anything 

out of school. YES yes 



Most children feel good about themselves 
in school. 



If a person doesn't finish school he 
won*t be respected. 



Education does not teach cooperation. 



Education earns you respect. 



YES yes 

YES yes 

YES yes 

YES yes 



no 



no 



no 



no 



no 



no 



no 



NO 



no NO 



NO 
NO 

NO 
NO 



no NO 

no NO 

no NO 

no VO 

no NO 

no NO 
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If you want a nice place to live and 
good family » it helps to have an 
education. 



Schools keep people caged up. 



Education helps you to be a good 
citizen. 



School wasted my tine. 



It^s not true that finishing school 
gets you a good job. 



In school people learn to figure 
things out. 



Education helps you become a happf 
person. 

Schools don't teach the things that 
count. 



ms yes ? no l>K) 

YES yes ? no NO 

YES yes ? no NO 

YES yes ? no NO 

YES yes ? no NO 

YES yes ? no NO 

YES yes ? no NO 

YES yes ? no NO 



2^0 
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Bor conr MMiiME 

«Nt It tiw liood Uitr Ctr yoit Hm food lift !• 



Gsttim aionf with othm 


YES 


yot 


Hnrim Mcurity 


ag 


yot 


ttinf ibto to f ifun thiqgs out 


YBS 


• fee 


0»im liMit y«u mat to do 


YES 




Liking yOUTMlf 


YBS 




Ming TMpaetid 


YBS 




Hnfiqf ft good job 


YBS 


yoe 


Bfting pioud o£ idbftt you m 


YBS 


y« 


Hnriqg pMce 


YBS 




Hnring plenty of aoMx 


YBS 


fee 


Being Strang and pownrftil 


YBS 


y~ 


Being happf 


YBS 


yoe 
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Mniiry/HAYdi 1071 

Ptoase tell us 9am things ycumlf 

1. Do you use vecipes? Yes Sowetlnes, ___ No 

2. Do you use order cttaloguos 

For clothing? Yes SoaotiiiiBS No 

For toys? Yes SqnetinBS No 

Vor household goods? Yes Sometimes No 

3. So you sew clothing? Yes Sometimes No 

4. Do you use patterns £6r sewing clothing? Ye s Sonetiines^^^^ No 

5. Do you read the Bible at hone? Yes Somtiaes .No 

6. Do you use the yellow pages in the phone book? Yes_ Sometiaes No 

7. Do you use road naps? Yes Somotiaes No 

a 

8. Do you read to ddldven? Yes SoastiaiBS No 

9. Do you read tiie sports page in the newspaper? Yes Sometiaes Ito 

10. If you have a school-age dilld» do you visit your diild*s 
teacher? Yes Sometimes No 

11. Do you read instruction manuals? Yes_ Sometimes No 

12. Do you use a libraiy? Yes Sometimes No 

13. Do you can vegetables? Yes Sometimes No_ 

14. Do you read the women's page of the newspaper? Yes Sometimes No_ 

15. Do you read the newspaper ads when you want to buf something? 
Yes Sometimes No 

16* Have you looked at the newspaper ads to find a job? 
Yes Sometimes No 

17, Do you read magazines? Yes Sometimes No 

18. Wiat magazines do you read? ____ 
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THANK YOU FOR YOUR GOGPERAnCN! 



PSYOXMBIRIC LABORATORY 

University of Wisconsin 
Madison 



INTERNAL EVALUATION 



ANALYSIS OF DATA FROM 
WISCONSIN ADULT BASIC EDUCATION 
ASSESSMENT BATTERY 



SS4 



EVALUATION OP THE HOME VISIT COMPONENT 

The three main components in the evaluation of the Rural 
Family Development program are: 

1) The TV component 

2) The TV and the content material component 

3) The home visit component 

The purpose of this report is to focus on the outcome 
of the home visit component of the program. The other two 
parts of the evaluation have been described elsewhere. 

the Field Experiment 

A field experiment was proposed to assess the impact of 
the home visitors in achieving the overall goals of the RFD 
program. To carry out this experimentation a pool of the 
potential clients was created using certain demographic infor- 
mation and interviews. One control and one treatment group 
with 50 members each, were randomly selected from the pool. 
Those in the control group and others who were not selected 
from the pool, were told that they would not receive home visits 
due to limited financial resources. They were, however, told 
that they could participate in the program by requesting any 
or all content materials using ACTION LINE and viewing the 
TV programs. 



In selecting subjects for the control or the treatment 
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group no stratification was done on the basis of age, educational 
level, SE<^ or sex. Honrever, there was sane restriction on the 
nunber of persons selected from each of the four counties - Dane, 
Green, Iowa, and Lafayette. Table 1 gives the distribution from 
each of the four counties in the control and the treatment group. 

Table 1: Distribution of Subjects by Location 



County 


Control 
Group 


Treatment 
Grot^ 


Dane 


18 


18 


Green 


14 


14 


Iowa and Lafayette 


18 


18 


TOTAL 


50 


50 





The above restriction in the randomization was necessitated 
due to administrative problems arising from the location of the 
home visitors relative to the clients and the cost of travel 
involved. 

There was a wide range of age in the whole population: from 
18 years to 77 years. Also the number of women enrolled was more 
than the number of males. Table 2 and Table 3 give the 
distribution of age and distribution of sex respectively, in the 
control and the treatment groups. 




. Table 2 t Distribution of Slibjects by Age 
in the Control and the Treatment Groups 



Age Range 


Control 
Group 


Treatment 
Group 


BelGw 25 years 


5 


3 


25-40 


18 


25 


41-55 


1 


15 


Over 55 years 


12 


7 


TOTAL 


50 


50 


Orerall age range 


18-74 


• 

17-77 


Mean Age 


43.3 


40.7 


Table 3: Distribution of Subiects bv Sex 
in the Control and the Treatment Groiq)s 


Sex 


Control 
Groi4> 


Treatment 
Group 


Males 


13 


16 


Females 


37 


34 


TOTAL 


50 


50 



Hie control group vfas designed to serve as a conparison for 
the treatment group. Hie menbers of the treatment group were 
visited by the hone visitors one hour per week or as long and often 
as the client had need. The clients were helped in accordance 
with the basic goals of the program. The home visitors provided 
helping relationships as a fiiend, assisted in dealing with the 
content materials and encouraged the watching of the TV programs. 
The control group had no access to the home visitors but had free 
access to watching the TV programs and to requesting the content 
materials if they so desired. No personal inducement was given to 
the control group to request the content materials or to watch the 
TV programs. However, they were aware of this on-going program 
as a consequence of promotional campaigns. 

Hie experimentation was carried out through a 20 week period. 
The details of this structured program are provided in RFD Second 
Year Report . Within two weeks after the end of the treatment 
period, each participant in the control and the treatment groups 
was given a test battery consisting of six measures. The test 
was individually administered to each of the participants by the 
field staff supervisors. 

Ihe Measures 

The measures are broadly divided into three main categories; 

1) Achievement 

2) Attitude 

3) Behavior. 

2za 



The achievement part consits of three separate measures 
consistent with the cognitive aspects of the RFD behavioral 
objectives. Conforming with a three -track system with coping 
skill as the main track and verbal and the numerical skills 
as the supporting tracks, three separate achievement measures 
consisting of the coping skills, verbal skills, and the 
numerical skills were used. Supposedly with a change in 
achievement or with other designed contacts through the pro- 
gram, a change in attitude would also be expected. To monitor 
the change in attitude, two measures were taken. One of the 
attitude measures relates to the internal -external control 
tocus, and the other relates to the attitude towards education. 
The change in behaviors was monitored by a single measure 
based on the transitional behavioral objectives of the RFD 
program. Thus, a total of six measures (dependent variables) 
were taken on each subject. 

The rationale and procedures for developing instruments 
for the above measures and their psychometric properties is 
described elsewhere in this report. The instruments employed 
for measuring the above six dependent variables are the 
following: 

1} Communications skills - It was measured by the first par 
of the Wisconsin Test of Adult Basic Education (WITABE) . It was 
tailor made test designed to measure verbal ability of the membe 
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in the control and the treatment groups. 

2) Computational skills - It was measiifesd by the second subtest 
of WITABE, which was also a tailor made test. 

3) Coping skills - It was measured by the third part o£ 
WITABE, and was tailor made for the purpose. 

All the above subtests are consistent with the behavioral 
objectives of the RFD program and are designed to measure abilities 
of the control and treatment groups at the level of their performances. 

4) Internal-External control - Wisconsin Adult Attitude 
Inventory (WIAAI) Part 1 was specially developed to mini tor internal - 
external control locus for disadvantaged adults . It measures the 
degree to which an individual considers his environment under his 
control or due to fate or luck. 

5) Attitude towards education - Wisconsin Adult Attitude 
Inventory (WIAAI) Part II was used to measure the attitude towards 
education. This was also a specially constructed scale suited to 
be used with disadvantaged adults. The scores reflect the degree 
of positive attitude toward learning or education. 

6) Measure of Behaviors - **The World About Me" was developed 
to measure the level of the actual behaviors possessed by the 
persons in the control and the treatment groups. "TTie World About 
Me" is a listing of the statements of behaviors drawn randomly 
from the transitional behavioral objectives of the RFD program. 




Data Collection 

Within two weeks after the termination of the program, the field staff 
supervisors were assigned the task of administering the test 
battery to each individual in the control and the treatment groups. 
The above six subtests were in the fom of a single booklet. The 
instruments were self administering and in all cases were power 
tests, that is the participants could take as much time as they 
wanted to respond to all the items. In no case was the test time 
longer than was approximated on the test booklets. 

For the final evaluation, eight of the participants, four frcra 
the c^^ntrol and four from the treatment group, were not availably 
for testing due to various reasons. Those unavailable for tesLing 
were either hospitalized, moved to an unknown address or did not 
want to participate. It will be assumed that this drop in the 
participants from the control and the treatment groups is comparable 
and does not lead to biasing to a significant degree. 

Data Analysis 

Hie design is essentially a one-way analysis of variance with 
the control and the treatment grot^ as the two levels of the 
factor. Six dependent measures were obtained on each subject. 

A multivariate test was performed on the data using the 
Multi-variance FINN Version 4 program (1968) to test the Null 
hypothesis that there is no difference between the control and 
the treatment groups on any of the six measures - verbal ability, 
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numerical ability, coping skill, internal- external control, attitude 
toward education, or behaviors. 

Table 4 gives the cell frequencies and Table 5 gives the 
observed cell means with standard deviations indicated in 
parentheses. 



Table 4 ; Frequencies in the Control and Treatment Groups 

Cell Frequency 

1. Control 46 

2. Treatment 46 

TCTAl"~ 92 



Table 5 : Observed Cell Means for Each of the Dependent Variables 



Cell Verbal Numerical Coping Int-Ext Attitude Behaviors 

1 13.11 13.41 25.48 49.37 76.63 39.09 
(5.50) (4.94) (9.42) (10.21) (19.26) (9.59) 

2 14.13 13.20 26.76 49.80 78.07 41.54 
(4.49) (4.24) (5.82) (6.20) (8.19) (7.17) 
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Results and Discussion 

The F-ratio for an overall multivariate test of equality of 
mean vectors wasi.0558. Tliis ratio vras not significant for 6 d.f . 
in the numerator and 79 d.f . in the denominator (the degrees of 
freedom in the denominator was 79 instead of 85 because 6 of the 
missing measures had to be estimated) at 0.05 level. Hie test 
was significant at a p value less than 0.3956. 

An overall multivariate F-test being not significant at a 
level of .05, indicates that there is no significant statistical 
difference in any of the six variables between the control and 
the treatment groiq>s. 

Although the test is not significant at the usually specified 
arbitrary statistical level of .05, a search for any change in 
any of the variables will be attempted on the ground that for a 
program like RFD, for underpriviloged adults and lasting for a 
brief span of 20 weeks, any possibilities of shooting over stringent 
statistical criteria are rare. Especially when we are looking 
to the effect of home visitors alone in the context of the whole 
project }/Aiere a TV and content center were also a part, perhaps 
massive changes in effect may not be expected, this is similar 
to a point raised by Peter Rossi* of the National Opinion Research Center 
who analogically said that "the introduction of modem medicine 
and modem sanitation procedures into a country which has had neither 

* 

"Boobytraps and Pitfalls in the Evaluation of Social Action 
Programs," in Proceedings of the Ameri can Statistical Association, 
1966. ~~ ■ 
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can very dramatically reduce morbidity and mortality, ... but each 
new gain in morbidity and mortality can be expected to be smaller 
and more difficult to achieve." 

This suggests that a statistically non -significant result in 
the home visit coraponent does not necessarily mean that the 
program as a whole (TV, Content and H.V.) had no effect. It could 
also be possible that the effect of TV and the content center 
conponents was there (both in control and treatment) and larger 
effects could not be produced by introducing the hone visit 
component. 

Hence, we will look for any trends in change due to treatment 
(H.V. component) to surmise if given longer treatment, the effect 
could be statistically significant. Of course this will mean more 
cost toward bringing about such a change. 

Table 5 gives the means for the control and treatment groups 
for each of the variables. It is evident that the cell means in 
the treatment group are generally higher than in the control group, 
except for the numerical skills. Also, of the six dependent 
variables, the largest difference in the treatment and the control 
groups is in the behaviors. The next largest difference is on the 
verbal and coping skills. The difference in means in the attitude 
scores is quite lew, so that it can hardly be attributed to change 
beyond random variation. 

To see what criterion level would have made such a small 
change statistically significant, we will reason that a univariate 
test could be used to test the variables of interest (behavior, 
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verb&l and coping) . 

Table 6 gives the sainple correlation matrix between the six 
dependent variables. The three factors are discernible from this 
matrix. The first was the achievement factor, comprising the 
verbal, numerical and the coping skills; the second was the 
attitude factor, comprising the internal-external construct and the 
attitude towards education; and the third was the behavioral 
factor, dealing with "The World About Me." 

Table 6 : Sarapje Correlation Matrix 





Verbal 


Numerical 


Coping 


Int-Ext AttiUide Behaviors 


Verbal 


1.000 








Numerical 


.827 


1.000 






Coping 


.764 


.803 


1.000 




Int-Ext 


.294 


.396 


.367 


1.000 


Attitude 


.324 


.354 


.392 


.636 1.000 


Behaviors 


.371 


.325 


.323 


.489 .405 1.000 



The same three factors were also evidenced in the conponent 
analysis of the correlation matrix. The three factors accounted 
for 56.661, 20.47% and 12.40% of variance, thus accounting a 
total of 89.53% variance. 

This means that it will not be unreasonable to use the 
univariate test of the equality of means for the behaviors at least. 
Table 7 gives the univariate F-ratios for each of the six variables 



and the probabilities at which they are significant. 



Table 7 : Univariate F-ratio for Each of the Variables 
and the Significance Probabilities 



Variable 


Hypothesis Mean 


Univariate F 


p less than 




Square 




1. Verbal 


24.011 


0.9529 


0.3316 


2. Nunerical 


1.087 


0.0513 


0.8214 


3. Coping 


37.837 


0.6174 


0.4341 


4. Int-Ext 


4.348 


0.0609 


0.8056 


5. Attitude 


47.348 


0.2162 


0.6431 


6. Behaviors 


138.794 


1.9363 


0.1675 



The univariate test shews that behaviors would have been significant 
statistically if our criterion were at 0.17 level. In other words, 
if we say that behaviors have changed, we will be wrong on the 
average 17 out of 100 times in doing so. 

We cannot look separately to verbal and coping skill 
univariate tests because they are strongly correlated. Hence, we 
can only say that there is some positive change in the verbal and 
numerical skills as indicated by the means of the two groups. 
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RFD FIELD DEMONSTRATION TBRMINATIW SURVEY REPORT 
Survey Deliminations and Methodology: 

This report pertains to a survey conducted on the effect- 
tiveness of some aspects of the RFD program delivery system, 
comprising three functions, vis., TV programs, independent 
home study materials, and Action Line telephone service. 

The survey was conducted by mailing a questionnaire 
(p. 2 34 ) and obtaining responses from two distinct groups of 
people. One of the groups was composed of mothers receiving 
aid to dependent children (ADC) in Dane County. There were 
1,272 individuals in this group, all females, to whom the 
questionnaires were sent. The second group of 2,950 respon- 
dents came from the RFD mailing list. This list included the 
names of every individual who made contact with RFD in any way 
as a participant, such as requests for home study materials, 
home visitor contacts, use of RFD Action Line, or even inquiries 
for incidental information. This list does not contain the 
names of any professional educator or professional social 
worker, except as a private individual in the ways specified 
above. 

The questionnaires were sent during June 1971, two weeks 
after the termination of the RFD field demonstration. Each 
questionnaire was sent by regular mail service, and was 
accompanied by a cover letter and a self -addressed, postpaid 
envelope in which the respondents were to return their responses. 
The questionnaire contained 19 questions, five requesting des- 
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Have you watdied the RFD television program? Please let us 
know how you liked it. We would appreciate your returning this 
form in the enclosed envelope. 

Thank you. 



1. Have you ever watched the RFD television program? 
yes no 

If no, skip to question 12. 

2. How often did you watch RFD? 

once occasionally often regularly 

3. How did you like RFD? 

poor fair good excellent 



4. Did you learn from RFD? 

no not much some a lot 

5. What did you learn? 



6. Did you learn things that you think you will use? 

no maybe probably already have used 

7. Did you see things that you already knew? 
no some a lot most 



8. How easy was the show to understand? 

very clear good not clear confused 

9, In general, \A\at did you like best? 
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10. In general, what did you like least? 



11. Hour vrould you like to see the programs changed? 



12. Did you ever send for any RFD materials? 
yes no 

13. How did you like the materials? 

poor fair good excellent _ 

14. How would you like to see the materials changed? 



IS. Did you ever use the Action Line? 
yes no 



16. Were you satisfied with the Action Line? 

no so-so very much yes 

In order for us to knew viiat kind of people like the program 
would you mind answering these questions . 

17. How old are you? ^ 

18. What is the last grade you completed in school? 

19. How many children live with you? 



Please use the back of these sheets for any other comments. 
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criptive responses and the remainder required putting a mark 

in the appropriate space. An average of ten minutes was 

required to respond to all the questions. The format was 
simple and easy to follow. 

The analysis reported here is from the responses received 
up to October 1, 1971. 

The first analysis is done on the data obtained from 
ADC mothers in Dane County. The second analysis is on the 
data from the members of RFD mailing list. The third analysis 
is on only the data from those members of the RFD mailing list 
whose educational level is less than high school. The reason 
for pulling out a sub-group from the comprehensive mailing 
list is to compare how a group which can be said to be RFD's 
potential clients, differs in their evaluation of RFD with the 
evaluation of all of the members of the RFD mailing list. The 
third group will be called the "RFD potential client like 
group . " 

Report of ADC Mothers Group 

Questionnaires were sent to 1,272 mothers in the group. 
Of this number 201 (15.8%) questionnaires were returned. 

Group characteristics were determined from the responses 
to questions 17 , 18 and 19 which asked the respondents to 
give their age, number of years in the school, and the number 
of children living with them. 
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Q ^7* Age -Responses on age were given by 134 out of 201 

(68.11) persons. The distribution by age is: 

Age Group Number of Persons 

26-30 40 29.8 

31-40 54 40.3 

41-50 33 24.6 

over 51 7 5.2 

134 100.0 

Q 18. Educational level - There were 124 (61.71) out of 201 

who answered the question on the number of years the 

respondent attended school. The distribution of responses 

Years in school number of persons 

less than 8 7 5.6 

8-10 29 23.4 

11-12 60 49.2 

Business § Technical 2 1.6 

1-2 college 13 10.5 

3-4 college 8 6.5 

More than above 5 4.0 

m nnrnr 

Q 19. Number of children living with the respondent - 178 out 
of 201 (88.6t) answered this question. The distribution 
table is given below: 

« 

Number of children number of persons 

0 2* 1.1 

1-2 93 52.2 

3-5 73 41.0 

more than 5 10 5.6 

* It is not possible to say precisely why two of the ADC 
mothers reported no children. 
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Rdsponses to the TV programs 



Questions 1 through 11 asked the respondents to express 
their opinions regarding RFD TV programs. Distribution of 
responses to each question is given below: 
Q 1. Have you ever watched RFD television programs? 

yes - 47 out of 201 (23.4%) No - 154 out of 201 (76.61) 
Q 2. How often did you watch RFD? (of those who saw TV program) 

Responded - 40 Not responded - 7 



Once 

Occasionally 

Often 

Regularly 



0 (01) 

27 (67. St) 

8 (20.01) 

5 (12.51) 



Q 3. How did you like RFD? (of those who saw TV program) 
Responded - 44 Not responded - 3 



Poor 
Fair 
Good 

Excellent 



3 (6.8%) 

2 (4.8%) 

26 (59.1%) 

13 (29.5%) 



Q 4. Did you learn from RFD? (of those who saw TV program) 
Responded - 42 Not responded • 5 



No 

Not much 
Some 
A lot 



4 
2 
27 
9 



(9.5%) 
(4.8%) 
(64.3%) 
(21.4%) 



Q 5. What did you learn? 



Household hints 9 

Recipes - cooking ideas 5 

Money -time saving ideas 3 

General information 2 

About Wisconsin history 2 

Budgeting 2 

Exercises 2 
Where to find information 1 



About local events 
About social agencies 
About wills 
About car care 
Sewing hints 
Gardening 
About health 
About guests 
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Q 6. Did you learn things that you think you will use? 
(of those who saw TV programs) 



Responded - 42 

No 4 

Maybe 5 

Probably 11 

Already have used 22 



Not responded - 5 



(9.51) 
(11.91) 
(26.21) 
(52.41) 



Q 7. Did you see things that you already knew? 
(of those who saw TV programs) 



Responded -44 

No 
Some 
A lot 
Most 



Not responded - 3 



1 
29 
6 
8 



(2.31) 
(65.91) 
(13.61) 
(18.21) 



Q 8. How easy was the show to understand? (of those who saw TV 

program) 

Not responded - 3 



Responded - 44 



Very clear 24 (54.5%) 

Good 17 (38.61) 

Not clear 1 (4.61) 

Confused 2 (2.3%) 

Q 9. In general, what did you like best? 



All of it 10 

Household hints 6 
Recipes - 

cooking ideas 5 

Presentation 2 

Action Line 2 

Interview - guests 2 

Jim Mader 2 

Gardening ideas 2 

Counr^y music 1 



Puppet 
Information 
Money saving 
ideas 
Sewing ideas 
Scenery 

Health, safety, 

sanitation 
Nothing 



Q 10. In general, what did you like least? 



Music 3 

Bad show time 2 

Not educational 1 

Puppet 1 
Too many subjects 

per show 1 
Haphazardness , no 

planning 1 



Moves too fast 
Interview with stars 
Interview with children 
Telling how to make a 
place for things, e.g., 
basket on door 1 



Q U. How wouli you like to see the programs changed? 

Continue as such 5 Less of puppet 

Would not change 2 Involve local people 

At different times 3 Eliminate guest stars 

More shows 1 Less relating to farming 

Hour show 1 More applied to house - 

Cover fewer topics 1 wife 

Slower pace 1 More general information 

More publicity about show 1 More hints 

More on budgeting 1 More on gardening 

Political promises - More on conservation 

results 1 More on current social 

problems 1 

Responses to Home Study Materials by ADC Mothers 

Questions 12-14 in the questionnaire asked the respondents 

to express their opinions regarding RFD content materials. 

The distribution of responses is given below: 

Q 12, Did you ever send for RFD materials? 

Yes - 21 (10.4%) Not responded - 6 (31) 

No - 174 (86.6%) 

Q 13. How did you like the materials? (of those who sent 

for materials) 

Poor 0 (0%) 

Fair 1 (4.8%) 

Good 10 (47.6%) 

Excellent 10 (47.6%) 

Q 14. How would you like to see the materials changed? 

(of those who sent for materials) 

Wouldn't 3 
More simple, :.ieaningful, 

useful for low income 2 

More on budgeting 1 

More on recipes and menus 1 

Money saving recipes 1 
For elderly menu for good 

nutrition 1 



Responses on Action Line by ADC Mothers 

Questions 15 and 16 were included to determine whether 
ADC mothers utilized the Action Line for problem -solving. 

The following responses were obtained: 
Q 15. Did you ever use the Action Line? 

Yes - 8 (4%) out of 201 

No - 193 (96%) 

Q 16. Were you satisfied with the Action Line?(of those 

who used Action Line) 

No - 0 (01) 
So-so - 1 (12.51) 
Very much - 1 (12.5%) 
Yes - 6 (75%) 

Summary of ADC Mothers Group Characteristics 

Of those ADC mothers who returned the questionnaire, (15,8%) 
the mean age was 37 years. The median educational level of 
the respondent group is 11-12 years of school grades completed, 
and the median number of children for the group is 1-2 children. 

Summary of the TV Program Reactions by ADC Mothers 

In summary, out of a total of 1,272 questionnaires sent to ADC 
mothers, 15.8 percent of them sent back their questionnaires. 
From a total of 201 questionnaires received, it is indicated 
that 2 3.4 percent of these people actually saw the TV progran. 
The majority of the viewers saw it occasionally and rated the 
TV programs mostly good to excellent. A majority of them 
expressed that they did learn something from the programs and 
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half had already applied what they had learned. A majority 
of the viewers felt that they already knew some of the infor- 
mation presented. Though the program was liked by the res- 
pondents in general, the items which were most favorite are 
household hings, recipes and format of presentation. 

No suggestions recommending improvements or changes in the 
program carried strong respondent support. Some, however, 
expressed the feeling that the timings of the showings should 
be changed. This is an odd response since each TV program 
was shown four days during the week at four different times 
during the day. 

Summary of Responses to Content Materials by ADC Mothers 

In summary, of the total 201 who sent back their questionnaires 
21 persons (10.41) requested the content materials. Of those 
who received the materials about one -half thought that the 
materials were excellent and an equal number thought that the 
materials were good. Only a few mothers responded to the 
question how the content materials could be improved. It might 
be rationalized that most of the subject matter or information 
desired by these mothers are already included in the RFD 
Content Centers. 

Summary of Responses to Action Line by ADC Mothers 

The Action Line was used by 8 o£ the 201 (4%) ADC mothers who 
sent back their questionnaires. Of those who used the Action 
Line, for the most part, almost all of them indicated a very 
favorable response towards it. 
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REPORT OF RPD MAILING LIST GROUP 

The RFD mailing list group consisted of names of 2,950 
participants to whom the questionnaires were sent. The 
return of questionnaires from this group was 917 (31.1%). 

Group characteristics 

As in the analysis of ADC mothers group, the group character- 
istics were obtained by using the responses of the returned 
questionnaires. Questions 17, 18 and 19 pertain to age, 
number of years in school and the number of children. The 
distribution of responses to each question are listed below. 

Q 17. Age - Out of 917 questionnaires received, 867 (94.5%) 

indicated their ages and 50 (5.5%) did not answer the 

question. Age distribution table is: 

Age 3 Persons %^ 

25 56 6.46 

26-30 87 10.03 

31-40 176 20.30 

41-50 181 20.88 

51-60 IBB 21.68 

over 60 179 20.65 

Q 18. Educational level - Out of 917 re55pondents , 865 (94.31) 

answered the question about their educational level. The 

following distribution table gives their responses: 

No. of Years in School # Persons %^ 

less than 8 17 1.96 

8-10 119 13.76 

11-12 334 38.61 
Business College 

Technical School 26 3.00 

1-2 years college 123 14.22 

3-4 years college 165 19.08 
more than 4 years 

college 81 9.37 
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Q 19. Number of children living with respondent - out of 

917, (91.91) respondents, 843 indicated the number of 
children that live with them. The distribution table of 
responses is given below. 



Responses on TV Showing 

* 

Questions 1 through 11 in the questionnaires related to the 
TV component of the program. The responses indicated below are 
based on 917 out of 2,950 or 31.1 percent of the questionnaires 
returned. A distribution of responses to each question is 
given below. 

Ql. Have you ever watched the RFD television progrj 

Responded - 917 Did not respond - 0 

Yes - 784 (85.51) 
No - 133 (14.5*) 

Q 2. How often did you watch RFD? (of those who saw TV programs) 

Responded - 744 (98.7%) Did not respond - 40 

Once 34 (4.51) 

, Occasionally 252 (33. 9t) 
Often 241 (32.4%) 

Regularly 217 (29.2%) 

Q 3. How did you like RFD? (of those who saw TV programs) 

Responded - 744 (98.7%) Did not respond - 40 

Poor 3 (0.4%) 



Number of chil dren 



# Persons 



0 

1-2 
3-5 

more than 5 



355 
268 
184 
36 



42.11 
31.79 
21.83 
4.27 



Fair 
Good 

Excellent 



69 (9.31) 
360 (49.4%) 
312 (41.9%) 
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Q 4. Did you learn from RFD? (of those who saw TV programs) 



Q 5. What did you learn: 

Total responses 819 (Some responded more than once) 
Household hints (364), recipes - cooking ideas (126), general 
information (53), about state (50), about people and from inter- 
views (24 + 19), money management, saving, better shopping (21), 
on where to get information and solve problems (20), gardening 
ideas, hints about fertilizers (11), health, safety (9), 
nutrition, diet (9), exercising (10), Wisconsin history (15), 
household repairs (9), conservation (6), legal affairs, citizen 
rights (8) , consumer information and protection (6) , general 
review (4), about farm (4), local area, cities, events (5), 
laundry tips (4), about antiques (3), masonry (3), children (3), 
master mixes (3), government agencies and how to contact (2), 
sewing hints (2), decordting ideas (2), time saver ideas (3), 
rural living (2), human relations (2), adult learning can be 
easy, interesting (2), good philosophy of life (2), and 
Dr. Joyce Brothers (2), new techniques (1), Indian history (1), 
do-it-yourself ideas (1), about cars, driving, maintenance (1), 
comfort index (1) , camping (1) , like the whole program (1) , 
some of my thinking outdated (1), Jim Mader's farm (1), building 
a pond (1), NFA (1), there is much help for the disadvantaged 



Responded 



734 



Did Not Respond - 50 



No 

Not much 
Some 
A lot 



4 (0.5%) 

41 (5.61) 

458 (62.41) 

231 (31.5%) 



(1). 
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Q 6. Did you leam things that you think you will use? 
(of those who saw TV programs) 

Responded -713 Did Not Respond - 71 

No 9 (1.21) 

Maybe 86 (12.11) 

Probably 225 (31.6%) 
Have used 

already 393 (55.1%) 

Q 7. Did you leam things that you think you already knew? 

(of those who saw TV programs) 

Responded - 719 Did Not Respond - 65 

No 26 (3.6%) 

Some 562 (78.2%) 

A lot 93 (12.9%) 

Most 38 (5.3%) 

Q 8. How easy was the show to understand? (of those who saw TV 

programs) 

Responded - 72 7 Did Not Respond - 57 

Very Clear 481 (66.2%) 

Good 239 (32.9%) 

Not clear 3 (0.4%) 

Confused 4 (0.5%) 

Q 9. In general what did you like best? 

Total responses 920 (Some persons responded more than once) 

Household hints (202), Jim Mader (125), recipes - cooking ideas 

(106), all of it (77), clarity of presentation (28), variety (26), 

interviews (79) - with stars - 27; with others - 52, repetition 

of shows, information, new ideas (20), places to visit, travel 

features (29), information about state (28), informal format 

(18), demonstrations (11), music (12), Edsel (9), guests (10), 

folksy feel down to earth (8), general enjoyment (7), information 

on where to find information and solve problems (12), interviews 

with local, prominent people (6), money management, money saving 

ideas (15), consumer information (8), farm visit (8), 
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nutrition diets (5), useful, informative, fun (4), shorts (4), 
about children (4), local sites, people (3), gardening (3), 
exercise (3), social problems (3), connects city people with 
farm living (3), Johnny Cash (3), family show (2), simplicity (2), 
relaxed pace (2), about conservation (2), home repairs (2), 
help older people (2), Shirley Young (2), Chief Black Hawk (2), 
master mix recipe (2), relevance (1), humor (1), people involved 
(1) , services offered (1), technical discussions (1), materials 
prompt (1), reliability of sources (1), don't play down to rural 
viewer (1), availability of information (1), outdoor programs 
(1) , antiques (1) /'how to" department (1), fanning hints (1), 
about health (1), science topics (1), human communications 
topics (1), information on local, national problems (1), educa- 
tion for children (1), tips for better living (1), Eddie Albert 

(1) , program on friends (1), show on point (1), Mader's 
description of rural living (1). 

Q 10. In general, what did you like least? Total responses - 306 
Nothing (43), interview with stars (84), poor filming music (2 3), 
too short (16), sound unclear (14), too simple (14), couldn't 
get station (10), time of broadcast (8), repetition, broadcast 
at different times (5), puppet (26), children (5), some quests, 
talent (4), hints, homemaking ideas (6), recipes, cooking ideas 
(4), too drawn out (2), Goose Island Ramblers (2), too rustic 
entertainment (2), not concentrated enough, too much covered 
too fast (9), Jim Mader (3), one rural setting (3), wasn't 
interesting (2) , on farming (4) , too much on Wisconsin history 

(2) , the fact that it is taped (1), jazzy way picture flickered 
on screen (1), gimmicks with staging (1), some sequences too 
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long (1), long openings, closing (1), too costly (l) , people 
on show (1), flashbacks to celebrity comments (1), homeinaker»s 
voice (1), too much emphasis on some local personalities (1), 
not in color (1), "That's a good tip from RFD" (1), information 
about future shows (1), hints come too fast (1), address given 
too quickly (1) , 

Q 11. How would you like to see the program changed? 
Total responses - 501 (some persons responded more than once) 
Continue or don't change the program (195), make it more advanced - 
adult (23), change timings (21), make longer shows (19), more 
local people, leaders, officials (15), better filming, sound, 
in color (14), cover fewer but better topics (12), more on 
Wisconsin places and people (14), more hints (16), more recipes 
(10), more on gardening, landscaping (10), eliminate interviews 
with stars (10), more on sewing, upholstering (9), more on 
ecology, conservation, forestry (7), Wisconsin history and 
folklore (6) , more on low priced hobbies (6) , more on small 
building projects (7) , more on consumer information (5) , on 
law (5), eliminate puppet, use people (5), clearer details on 
where to write (5), constant time of showing (4), more experts 
and University people (4) , more demonstration (4) , on money 
management and shopping (4) , on health (3) , comparison and 
problems of rural, city life (3), farming hints (3), have 
regular series of tips, demonstrations in one area (3), local 
projects, events (3), faster pace (3), include ideas for teens, 
all ages (3), on food preservation (2), decorating (2), rural 
living (2), county aid (2), short tours (2), more updated 
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information (2), art appreciation, longer interviews (2), 
less entertainment, more information (2), sponsor TV TS and 
college courses (2) , less corny (1) , smoother presentation (1) , 
more guests (1), more popular people (1), more interviews (1), 
and interview in home situation (1), don't have taped inter- 
views (1) , interview participants (1) , make Jim Mader a more 
distinctive character (1) , make Miss Young more enthusiastic 
(1), more music (1), some old time music (1), better music (1), 
less of theme song (1) , use a variety of state bands (1) , 
present play or act (1), more religious emphasis (1), local 
attraction reviewed (1), have contests (1), geared to average 
income family (1) , send complete program of shows (1) , take 
out 30 second spots, too disjointed (1), concentrate on one 
area/week, 5 minutes per unit per week (1), places interesting 
to retired people (1), state officials duties, offices (1), 
politics (1), fishing recreation ideas (1), show family projects 
and hobbies (1), insurance (1), income tax (1), stock market (1) , 
education (1), do it yourself projects (1), how to do (1), on 
natural food (1), on cake decorating (1), how to find family 
tree (1), games for children (1), ideas of more universal 
interest (1), no gourmet cooking (1), less on pollution (1), 
stop shows (1) . 

Responses on Content Materials 

Out of 917 (31.1%) persons who returned questionnaires, 711 
(77.51) indicated that they had sent for content materials. 
Questions 12, 13 and 14 related to the content materials. The 
following responses were obtained from those who had sent for 
materials. 
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Q 13. How did you like the materials? 
Responded - 711 
Poor 13 (1.71) 

Fair 68 (9.61) ; 

Good 346 (48.71) 

Excellent 284 (40.0%) 

Q 14. How would you like to see the materials changed? 

Total responses given - 247 
Wouldn't (94), too simple, make more adult (30), excess paper, 
make less bulky and wasteful (18) , too much sent (14) , send 
quicker (13), send more materials (9), couldn't get what 
wanted (7), got papers late (6), too concise (5), make detailed 
(5), more on recipes (5), more on sewing (3), some too compli- 
cated (2), make more complete (2), too detailed (2), some not 
practical (2), eliminate expensive binder, provide complete 
list of materials (2) , make government bulletins available 
through RFD (2), condense recipes to file card size (2), more 
on crafts (2), too academic (1), use simplest form possible (1), 
it is more summary type and less explanatory (1), too general 
(1) , difficult to file (1), add more colorful pictures (1), 
use both sides of paper (1) , use paper bound booklets rather 
than loose leaf (1), don't waste time, paper on correspondence 
saying materials are coming (1), have one blank for each 
content center (1) , have materials sent regularly (1 per month) 
(1), have weekly bulletin, include good index with each 
unit (1) , homemakers send in favorite recipes (1) , government 
materials so simple (1) , game about balanced menus too simple 
(1), have bigger variety (1), more on hints (1), health (1), 
knitting (1), human relations (1), money (1), heredity (1), 
environment (1) . 
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Responses on Action Line 

Questions IS and 16 in the questionnaire related to the Action 
Line component. The responses are: 

Q IS. Did you ever use the Action Line? 

Responded - 853 Did not respond - 64 

Yes 300 (35.2t) 

No 553 (64.8*) 

Q 16. Were you satisfied with the Action Line? 

Responded - 300 

No 22 (7.3*) 

So-So 32 (10.7*) 

Very much 97 (32.3*) 

Yes 149 (49.7*) 

Summary of Group characteristics of RFD Mailing List Group 

The tables above indicate that the audience in this group has 
a very wide span in their age as well as educational level. 
The median age group of this audience is 41-50 years. The 
educational level ranges from less than 8th grade to more 
than 4 years in college. Slightly more than half of the 
respondents had less than 12 years of school education. 

The table above also indicates that nearly 75 percent of the 
persons had less than 2 children, and nearly one -fourth had 
3 or more children. The 42 percent who are childless might 
fall into two age groups. One of lower age, unmarried or 
recently married and the other 41 years and older whose 
children may have grown and were living away from home. (It 
may be noted that 63.21 percent of this group is 41 years 
and older) . 
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Summary of TV Program Reactions by RFD Mailing List Group 

0£ those who returned the questionnaire, 85.5 percent actually 
watched the TV shows. Approximately two-thiids indicated 
that they saw the shows often or regularly while about one 
third indicated that they saw the shows occasionally. Ninety 
percent of them indicated that the show was "good" or "excellent 
9,3 percent thought that it was "fair" and a negligible number 
(0,4%) indicated that it was "poor," Ninety four percent 
indicated that they had learned from the program, and 55,1 
percent said they had already used things mentioned in the 
program. In addition, 31,6 percent indicated probable future 
use. About 12 percent were not sure if they would ever use 
anything from the program. However, almost all of them indi- 
cated that they already knew something at least before they 
saw it on the program. Almost all of them rated the programs 
"good" on clarity and understandability , 

Respondents were also asked what particular things they had 
learned, what things they liked least, what things they liked 
best, and hwo they would like to see the program changed. 
The most frequently learned things from the program were the 
household hints, cooking ideas, and general information, money 
management and about people. Almost all other things in the 
programs were mentioned but by fewer people. It appears that 
they learned the things they liked best. The things they 
liked best in rank order are: household hints, cooking ideas, 
interviews and information about the state. To be especially 
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noted is that 77 people (8.4*) stated that they liked all 
of it, and 105 (11.4%) that they liked Jim Mader best. 

The least liked things in the program were "interviews with 
stars," "Puppet," and "music." Also, some of their dislike 
comes from poor reception and timing because a good many 
indicated that they had problems in getting the station or 
that the show times did not suit them. On being asked how 
they wanted to see the program changed, most of them replied 
not to change or to continue as such. Some did feel that the 
program was a little too simple and needed to be more adult- 
like - more advanced. It may be that these responses came 
from college educated persons, but no attempt was made in 
the analysis to explore this.* 

* The analysis of responses from "Potential RFD client like 
group" sheds some light on this hypothesis. See page 255 of 
this report. 

Summary of Responses to Content Materials by RFD Mailing List Group 

To summarize, 77.5 percent of those who returned the question- 
naires received the content materials. A total of 88.7 per- 
cent thought that the materials were "good" or "excellent." 
Nearly 10 percent felt that the materials were of "fair" quality 
and 1.7 percent thought that they were of "poor" quality. 
When these people were asked, how would they like to see the 
materials changed, their responses indicated that they did 
not want any change. Others indicated that the materials were 
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very easy and therefore needed to be made adult like. The 
detailed responses are given above. 

Summary of Responses to Action Line by RFD Mailing List Group 

Of those who responded to question 15, 35.2 percent actually 
used Action Line. Of those who used Action Line, 82 percent 
were very satisfied with the Action Line, 10.7 percent felt 
"so-so" and 7.3 percent were dissatisfied with Action Line. 

Response on "Comments" 

The respondents were also asked to express freely regarding 
anything that they felt uppermost in their minds regarding RFD. 
Out of 917 persons who returned questionnaires only 74 persons 
wrote their comments. Seventeen of the responses indicated 
that "RFD is a necessary show." Other comments which occurred 
more than once were: program is a good idea (9), would like 
to have watched (6), it is a program all the family can enjoy (5), 
it is learning without leaving home (S) . 
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INTERNAL EVALUATION 

REPORT OF RFD POTENTIAL 
CLIENT-LIKE GROUP 



REPORT OF RFD POTENTIAL CLIENT- LIKE GROUP 

The'*RFD potential client- like group" has been derived out 
of the RFD 861 Mailing List. They include only those whose 
educational level is less than high school. A total of 917 
questionnaires were returned from the RFD Mailing List out 
of which 152 ( 16.58%) belonged to the "potential client- like 
group." 

Group Characteristics 

Group characteristics were determined from the responses to 
questions 17, 18 and 19 which asked the respondents to fill 
in their age, number of years in school, and the number of 
children living with them. 

a) Age - Responses on age were given by ISl ( 99.341) 
of 152 persons. The distribution of ages is: 

Age group Number of persons 1^ 

less than 25 years 13 8.61 



b) Educational level - All 152 individuals responded to the 
question about formal education. 



26-35 
36-45 
46-55 



14 
14 
28 
82 



9.27 
9.27 
18.54 
54.31 



56 and over 



No. of years in school 



Number of persons 



I 



11 
10 
9 
8 



15 
14 
11 
93 
19 



9.87 
9.21 
7.24 
61. 18 
12.50 



less than 8 
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c) Number of children living with respondent - 145 out of 152 
(95.391) indicated the number of children that live with 
them. 

Number of children Number of persons 1^ 

0 ^ 92 63.45 

1-2 20 13.79 

3-4 18 12.41 

5 or over 15 10.35 

Responses on TV program 

Questions 1 through 11 in the questionnaire asked about the 
TV programs. The distribution of responses below is based on 
152 questionnaires. 

1. Have you ever watched the RFD Television program? 

Responded - 152 Did not respond- 0 

Yes 130 (85.531) 

No 22 ( 14.47%) 

2. How often did you watch RFD? 

Responded - 128 ( 98.46%) Did not respond -2 

Once 4 ( 3 .12%) ( from those who saw TV) 

Occasionally 29 (22 .66%) 

Often 50 (39 .06%) 

Regularly 45 (35 .16%) 

3. How did you like RFD? ( of those who saw TV programs) 

Responded - 128 (98.46%) Did not respond -2 

Poor 0 ( cot ) 

Fair 9 ( 7.03%) 

Good 60 (46.88%) 

Excellent 59 (46.09%) 

4. Did you learn from RFD? ( of those who saw TV programs) 

Responded- 125 (96.15%) Did not respond - 5 

No 0(0%) 

Not much 4 ( 3.20%) 

Some 71 (56.80%) 

A lot 50 (40.00%) 
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5. Did you learn things that you think you will use? 
(of those who saw TV programs) 

Responded - 125 (96.15%) Did Not Respond - 5 

No 2 ( 1.60%) 

Maybe 14 (11.20%) 

Probably 52 (41.60%) 
Have used 

already 57 (45.60%) 

6. Did you learn things that you think you already knew? 
(of those who saw TV programs) 

Responded 128 (98.46%) Did not respond - 2 

No 9 ( 7.03%) 

Some 104 (81.25%) 

A lot 9 ( 7.03%) 

Most 6 ( 4.69%) 

7. How easy was the show to understand? (of those who saw TV programs) 

Responded - 128 (98.46%) Did not respond - 2 

Very clear 70 (54.69%) 

Good 54 (42.19%) 

Not clear 3 ( 2.34%) 

Confused 1 ( 0.78%) 

8. What did you learn? 

Total responses - 84 (some responded more than once) 
Hints (56), Tips and ideas (8), household hints (17), safety 
hints (3), cooking hints and recipes (22), other hints (6), 
buying ideas (2), understanding rural life (2), legal affairs 
(2), laundry methods (2), history of Wisconsin (3), better 
health (2), how to reach people, where to go, who to see, what 
to do (1), sanitation ideas (1), revised forgotten things (1), 
about stars (3), meal planning (1), interview with people (7), 
lots of questions answered (1). 
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9. In general, what did you like best? 

Total responses - 114 (some people responded more than once) 
Liked everything (30) , various "how to" hints (11) , cooking 
ideas and recipes (18), interview with stars (14), interview with 
guests or important people (11) , questions and answers (4) , 
Jim Mader (6), interview with children (2), feature on small town 
or New Glarus (5), presentation (3), music (2), Wisconsin history 
(2), about antiques (1), nutrition (1), having show on 4 days (1) , 
new ideas (1), Blue Goose Rambler (2). 

10. In general, what did you like least? 

Total responses - 44 (some responded more than once) 
Completely satisfied or disliked nothing (20) , interviews with 
stars or guests (8), music; they reported that background noisy - 
(2) , puppet (3) , not completing a subject (1) , Goose Island 
Ramblers (2), show altogether too short (2), recipes (3), about 
cars (1), show times not good (1), farm areas (1). 

11. How would you like tc see the program changed? 

Total responses - 51 (some responded more than once) 
Do not change or just fine or keep as it is (26), trouble 
getting Channel 21 (3), more recipes and hints (5), add on 
sewing (2), increase time to one hour (2), more general infor- 
mation (3), more Wisconsin folklore (1), more question -answer (1) , 
add on mortgages (1), don't use puppet (2), addresses given too 
fast (1) , current events (1) , add how to choose quality 
products (1), eliminating violence (1), how to stop disloyalties 
and dishonesties in government (1) . 
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Responses on content materials 

The frequency of responses given below are based on 152 
questionnaires from the individuals who belonged to "RFD client - 
like group." Questions 12, 13 and 14 in the questionnaire related 
to the content materials. 

12. Did you ever send for any RFD materials? 

Responded - 152 Did not respond - 0 

Yes 127 (83.55%) 

No 25 (16.45%) 

13. How did you like the materials? (of those who sent for 

materials) 

Responded -127 Did not respond - 0 

Poor 3 ( 2.36%) 

Fair 8 (6.30%) 

Good 57 (44.88%) 

Excellent 59 (46.46%) 

14. How would you like to see the materials changed? 
(of those who sent for materials) 

Total responses - 26 (some gave more than one response) 
They responded as follows: do not change and liked what I 
received (17), add sewing and knitting ideas (2), material 
should be on a higher level or make more adult like (2) , don't 
duplicate information already from state agency (1) , more 
colorful pictures (1), avoid expensive binders (1), add on 
flower arrangement (1), cake decorating (1). 

Responses on ACTION LINE 

Questions 15 and 16 in the questionnaire related to the Action 
Line. The frequency of responses are given below: 
Q 15, Did you ever use the Action Line? 

Responded - 152 Not responded - 0 
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Yes 

No 



53 (S4.87t) 
99 (65.13t) 



Q 16. Were you satisfied with the Action Line? (of those who 

used Action Line) 



Summar)' of characteristics of RFD client -like group 

This group has been pulled out of the RFD mailing list which is 
a listing of names of people from many walks of life. It is 
interesting to note that if we slice the comprehensive mailing 
list on the basis of educational level (less than 12th grade 
education) , a very characteristic group people emerges from 
this list. More than half of these people are 56 years and 
older. They (56 years or older) are the people whose educational 
level is 8th grade or less, and their children have left home. 
About 20% of them are between the ages of 46 and 55 and nearly 
25% are less than 45 years of age. A cursory glance on the 
data indicates that educational level increases with decreasing 
age in this group, also the lower the age, the greater the 
number of children living with them. The group is formed of 
nuclear families with possibly several small children and a 
common thread of low educational level among the parents. 

Summary of responses on TV programs 

A very large proportion (86%) of this sub group watched the 
TV program. Nearly 75 percent of those who watched, saw the 
program often or regularly. About 92 percent rated the show "good" 



Responded - 53 



Did not respond - 0 



No 

So-so 
Very much 
Yes 



1 ( 1.89%) 

5 ( 9.43%) 

16 (30.19%) 

31 (58.49%) 
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or "excellent." None rated the show "poor" and only 7 percent 
rated it "fair." Asked if they learned from RFD, 40 percent 
responded "a lot", and 57 percent "some." Again, none indicated 
"no" in response to this question. About 45 percent of the 
people indicated that they had already used something that they 
learned through the program. Forty two percent stated that 
they "probably" will use something. One and six-tenth percent 
indicated that they learned nothing they will use. A large 
percentage (81%) indicated that they had already known some 
things they saw in the program. About 7 percent did not previ- 
ously know anything and about 12 percent knew quite "a lot" 
about the substance of _the program. On being asked, how easy 
was the show to understand, 97 percent stated that the show was 
"good" or "very clear," but 3 percent did not think so. 

Among the responses to the question asking what they did learn, 
most frequent were hints, recipes and interviews. Others, but 
less frequent were knowledge of legal affairs, Wisconsin 
history, interview with stars, health care, understanding 
rural life. 

Asked what they liked best, the single most frequent (27%) 
responses were "liked everything." Specifically mentioned 
were hints, recipes, cooking ideas, interviews with stars and 
quests. Less frequent, but also mentioned were Jim Mader, 
feature on Sinall town &nd presentation. 

On being asked, what did you like least, the single most 
frequent (45%) response was "disliked nothing." Specifically 
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mentioned least liked, but with much smaller numbers of people 
were interview with stars, puppet, music (because the back- 
ground was noisy) and Goose Island Ramblers. Some 6 percent 
of the responses indicated that they did not like the recipes. 

Asked how they would like to see the program changed, about 
50 percent responded "just fine." There were no worthwhile 
suggestions for improving the format or substance of the program 
A few indicated their preferences included topics like sewing, 
how to eliminate violence, more general information, more 
recipes and more on folklore. It was also indicated that the 
RFD address and telephone numbers were given too fast for one 
to write them down. 

Summary of responses on content materials 

The first question on the content material was to find out 
how many people actuall> sent for materials. Eighty-four 
percent of this group (127 out of 152) actually sent for 
materials. About 90 percent of them stated that the materials 
sent to them were "good" or "excellent." Only 2.3 percent 
thought that the materials were "poor," and 6.3 percent rated 
the materials as "fair." 

Asked how they would like to see the materials changed, 73 per- 
cent offered no changes. A few people (5 or 6) indicated a 
preferences for adding materials like: sewing and knitting 
ideas, cake decoration and flower arrangement. Two people 
indicated a desire for the materials to be more adult like. 
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A much larger proportion of the total RFD mailing list 
indicated the same preference. The two responses from this 
group lends support to the hypothesis made earlier that 
perhaps more educated people feel that the material is so 
easy that it is not adult like. 

Summary of Responses on Action Line 

The first question about the Action Line was to determine how 
many people actually used it. Thirty five percent (53 out of 
152) stated that they had. Asked if they were satisfied with 
Action Line, about 90 percent indicated "very much." Only 
one person stated that he was not satisfied and about 10 
percent rated his satisfaction "so-so." 

Summary of Responses on Comments 

The last question provided an opportunity for the respondent 
to make comments, A number of interesting comments were made, 
from a philosophical evaluation of the program to objective 
remarks about its content and format. But it was commented 
again and again: "I miss RFD," "come next fall," "keep it up," 
"Jim is great," Many seemed to be irritated that they could 
not receive Channel 21, The respondents generally expressed 
satisfaction and their gratification for the effort. None 
made ar. adverse comment. 
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Evaluation of Effectiveness of Home Visitors Interview -Questionnaire 

For the evaluation of the home -visit component, a field experi- 
ment was conducted in which, from a pool of potential RFD 
clients, 50 persons were assigned randomly to a control group 
and an equal number of persons were assigned randomly to a 
treatment group. A complete description of the experimentation 
and sampling is described in earlier sections of this report. 

To evaluate the effectiveness of the home -visitor, two techniques 
were used. The first was the Wisconsin Adult Basic Education 
Assessment Battery which measured cognitive and affective changes. 
It is reported elsewhere in this report. The other technique 
employed a comprehensive interview seeking information from the 
subjects of both the control and treatment groups based on the 
objectives of the RFD program. It is the purpose of this section 
to describe the interview data. 

Methodology - A comprehensive questionnaire was devised (see 
page ) to assess the attainment of the behavioral objectives 
of the RFD program. It was designed to be administered by 
interviewers. Four interviewers (who previously served as 
home -visitors) were given a one day training session focused on 
soliciting responses to the questionnaire. It was emphasized 
that responses to the questions should be elicited only after 
fully exploring the extent of achievement of an objective. 
Thus the responses were not based on the whims of the subjects 
and a uniformity of scoring procedure was subjectively attained 
by using the interviewers. The interviewers were assigned to 
reach the subjects on the basis of minimum travel cost. 
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Psyclwmetric Laborator>' 
University of Wisconsin 

RFD EVALUATION QUESTIONN/VIRE 

1. Did you watch the RFD television program? Yes No 

2. If yes, how often did you watch? 

3. Did you have a hone study visitor? Yes No 

4. Did you order RFD materials? Yes No 

Did you get what your ordered? Yes No 

Did the materials you received provide you with 
the infoimation you desired? Yes No 

5. If yes, which materials did you order? 

6. Did you ever see the Almanac? Yes No 

7. Did /ou use the Action Line? Yes No 

8. Did you hear RFD radio programs? Yes No 

9. How did you hear about RFD? 



r 
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10. In what ways do you think you have changed as a result of 
RFD? 

(Inteiviewer must draw person out and be sure to note 
idiosyncratic changes and connents.) 
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Has RFD in any way improved your: Explain. 

a) personal development 

b) family relations 

c) handling of money 

d) use of cannunity services to help yourself 
(library, parks, playgrounds, ag. eactension, sheriff, 
police, fire dept) 

e) ise of social services such as Social Security 
tenefits, visiting nurse, stamp food plans, etc. 

f) appreciation of your environment 

g) work on the job 

h) connunication with other people 

i) health 
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Haw much do you think you have learned as a result or RPI)? 

None A Little A Lot 

a) arithmetic 



reading 



writing 



local § national 
politics 



heme safety 



understanding people 



using local services 



connunicating with 
strangers on the 
telephone 

home and farm 
management 



job skills 
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13. Do you use recipes or foimulas for mixing thinRS? 
Yes Sometimes No 

14. Do you use mail order catalogues? Yes Sometimes Nb_ 

15. Do you sew and alter clothing or do hone repairs? 
Yes Scmetimes No 

16. Do you use patterns for sewing clothing or use blueprints for 
building? Yes Sometimes No 

17. Do you use the yellow pages in the telephone book? 
Yes Sometimes No 

18. Do you use road maps? Yes Sometimes No 

19. Do ycu read to children? Yes Sometimes No 

20. Do you read newspapers? Yes No 

21. Do you read magazines? Yes No 

22. Do you read the sports page or woman's page in the newspaper? 
Yes Sometimes No 

23. If you have school age children, do you visit their teachers? 
Yes Sometimes No 

24. If you have children, do you help them with their homework? 
Yes Scmetimes No 

25. Do you read appliance or equipment instruction manuals? 
Yes Sometimes No 

26. Do you can meat, fruits and vegetables? Yes Scmetimes 

27. Do you have a library card? Yes No 
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28. Do you use a library? Yes Scmetimes No 

29. Do you yourself read letters fron relatives and friends? 
Yes No 

30. Do you write letters to relatives and friends? Yes No 

31. Do you write to your government representatives? Yes No__ 

32. Do you write letters of complaint? Yes Sanetijnes No_^ 

33. Do you use a dictionary? Yes N o 

34 . Do you or your spouse make menus for the day or week? 
Yes Sometimes No 

35. Do you read the advertisements before you go shopping for 
groceries? 

Yes Sometimes No 

36. Have you filled out work application forms? Yes No 

37. Do you have a driver's license? Yes No 

38. Do you vote? Yes Sometimes No 

39. Do you keep and read identifying labels on medicines, poisons 
and other heme chemicals? Yes Sometimes No 

40. Do you knew the difference between, fact and opinion in politics 
and other crucial areas of concern? Yes Sometimes No__ 

41. Do you listen with purpose to radio and television news and 
InfoTmation programs? Yes Sometimes No 

42. Do you keep a simple budget for one month periods? Yes No 
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43. Can you detemdne the price of a single item i«hen the article 
is being sold in sets of 2,3,4 and 5? Yes No 

44. Can you use the index of a book to find specific infoimation? 
Yes No 

45. Do you know how to seek ad\rice and action frcnt local, state 
and national agencies? Yes Sonietiines No 

46. Do you keep and balance a bank checking account? Yes No 

47. Do you figure and ccniplete your own income tax forms? Yes_ No__ 

48. Do you read and question any docunent before signing your 
personal signature? Yes Sometimes No 

49. Do you get along well at work with fellow workers and do you 
carry out instructions well on the job? Yes Sometimes No^ 

50. Have you been improving your job skills? Yes No 

51. Have you sought advanced skills through vocational school programs? 
Yes Sometimes No 



Name: 
Age: 
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The questionnaire responses were obtained during October and 
November, 1971, about 18 weeks after the termination of the 
program. The unduly long time interval between the end of 
the program and interview lead to the unavailability of many 
a subjects. Some did not wish to give time for this inter- 
view, a few were apprehensive of divulging any personal infor- 
mation, and a large number of people had moved to other places. 
The analysis is based on the assumption that the missing 
responses from both the control and treatment groups are 
comparabli and do not lead to significant bias. 

The responses to various questions are summarized below. 
Questions 1 through 9 give a descriptive view about the amount 
of treatment given to the control and treatment groups. 
Questions 10 through 49 provide data about the attainment of 
each of the objectives . 

Primary Information Regarding the Program 



Questions 



Control Group 'Treatment Group 
Responses Responses 



1. Did you watch the RFD TV 
program? 

Yes 
No 



19 (65.51) 
10 (34.5%) 



33 (86.8%) 
5 (13.2%) 



2. If yes, how often did you watch? 



Not at all 
1-3 times 

4-8 times (once in a while) 

9-15 times (about 1/2) 

Once a week 

More than once a week 

No answer 



3 (10.3%) 
7 (24.1%) 
5 (17.2%) 
5 (17.2%) 

4 (13.8%) 
4 (13.8%) 
1 ( 3.6%) 



1 ( 2.6%) 
11 (29.0%) 
11 (29.0%) 

4 (10.5%) 

6 (15.8%) 

3 ( 7.f%) 

2 ( 5.:i%) 
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3. Did you have Home Study Visitor? 

Yes 1* ( 3.5*) 38 (100%) 

No 28 (96.51) 0 01 

4. Did you order RFD materials? 

Yes 18 (62.0%) 36 (94.71) 

No 11 (38.0%) 2 ( S.3%) 

*i:icidental personal contact by Mrs. Rufener, Home Visitor 

4a. Did you get what you ordered? 

Yes 15 (83.3%) 32 (84.2%) 

No 3 (16.7%) 2 ( 5.3%) 

Not always 4 (10.5%) 

4b. Did the materials provide you 

with the information you desired? 

Yes 15 (51.7%) 32 (84.2%) 

No 3 (10.3%) 2 ( 5.3%) 

Not always 4 (10.5%) * 

6. Did you ever see the Almanac? 

Yes 21 (72.4%) 35 (92.1%) 

No 7 (24.1%) 3 ( 7.9%) 

Not answered 1 ( 3.5%) 

7. Did you use the Action Line? 

Yes 5 (17.2%) 14 ^36. 8%) 

No 24 (82.8%) 24 (63.2%) 

8. Did you hear RI'D radio program? 

Yes 9 (31.0%) 11 (29,0%) 

No 20 (69.0%) 27 (71.0%) 

RESPONSES SHOWING THE ATTAINMENT CF EACH OBJECTIVE 

12. How much do you think you have learned as a result of RFD? 

Response 

. , Categories Control Treatment Chi -square 

a) Arithmetic None 18 (72.0%) 28 (73.7%) 2 df. 

A little 6 (24.0%) 7 (18.4%) 0.593 

A lot 1 ( 4.0%) 3 ( 7.9%) 

Not answered 4 (13.7%) 

b) Reading None 16 (64.0%) 20 (52.6%) 2 df. 

A little 6 (24.0%) 13 (34.2%) 0.878 

A lot 3 (12.0%) 5 (13.2%) 

Not answered 4 (13.8%) 
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Response 
Categories 



c) Writing 



d) Local § 
national 
politics 



None 

A little 
A lot 
Not answered 

None 
A little 
A lot 
Not answered 



e) Home safety 



None 

A little 
A lot 
Not answered 



f) Understanding 
people 



None 
A little 
A lot 
Not answered 



g) Using local 
services 



None 

A little 
A lot 
Not answered 



h) Communicating None 
with strangers A little 
on the phone A lot 

Not answered 



i) Home and farm 
management 



j) Job skills 



None 
A little 
A lot 
Not answered 

None 
A little 
A lot 
Not answered 



13. Do you use recipes 
or formulas for Yes 
mixing things? Sometimes 

No 

'4. Do you use mail 

order catalogs? Yes 

Sometimes 
No 
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Control Treatment Chi -square 



22 (75.91) 

2 ( 6.91) 

1 ( 3.51) 

4 (13.7%) 



(76.0%) 

(: 



19 

4 (16.0%) 

2 ( 8.0%) 

4 (13.8%) 



11 (44.0%) 

9 (36.0%) 

5 (20.0%) 
4 (13.8%) 

11 (44.0%) 

10 (40.0%) 

4 (16.0%) 

4 (13.8%) 

16 (64.0%) 

6 (24.0%) 

3 (12.0%) 

4 (13.8%) 

20 (83.3%) 

1 ( 4.2%) 

3 (12.5%) 

5 (17.2%) 

14 (56.0%) 

8 (32.0%) 

3 (12.0%) 

4 (13.8%) 

20 (83.3%) 

4 (16.7%) 
0 ( 0.0%) 

5 (17.2%) 



18 (62.1%) 
" (24.1%) 
4 (13.8%) 



14 (48.3%) 
6 (20.7%) 
9 (31.0%) 



30 (79.0%) 

5 (13.2%) 

2 ( 5.2%) 
1 ( 2.6%) 

25 (65.8%) 
10 (26.3%) 

3 ( 7.9%) 



10 (26.3%) 
18 (47.4%) 
10 (26.3%) 



1. (44.7%) 
16 (42.1%) 
5 (13.21) 



26 (68.4%) 
7 (18.4%) 
5 (13.2%) 



25 (65.8%) 
10 (26.3%) 
3 ( 7.9%) 



17 
14 
6 
1 

24 
11 
2 
1 



24 

9 
5 



17 
13 
8 



(45.9%) 
(37.8%) 
(16.3%) 
( 2.6%) 

(64.9%) 
(29.7%) 



( 
( 



5.4%) 
2.6%) 



(63.2%) 
(23.71) 
(13.1%) 



(44,7%) 
(34.2%) 
(21.1%) 



2 df. 
0.547 



2 df. 
0.947 



2 df. 
2.122 



2 df. 
0.103 



2 df. 
0.287 



2 df. 
5.013 



2 df. 
0.627 



2 df. 
2.996 



2 df. 
0.009 



2 

1 



df. 

750 
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Rdsponse 
Categories 



Control Treatment Chi -square 



15. 



16. 



17. 



19. 



20. 



21. 



Do you sew and alter 
clothing or do home 
repairs? 

Do you use patterns 
for sewing clothing 
or use blue prints 
for buildings? 

Do you use the yellow 
pages in the tele- 
phone book? 



Do you read to 
children? 



Do you read news- 
papers? 

Do you read 
magazines? 



Not 



Not 



Not 



22 . Do you read the 
sports page or 
woman's page in 
the newspaper? 



Not 



2 3. If you have school 
age children, do 
you visit their 



Not 

24. If you have 
children, do you 
help them with 
their homework? Not 

25. Do you read appliance 
or equipment in- 
struction manuals? 

Not 



Yes 


17 


(60.7%) 


25 


(65.8%) 


2 


df. 


Sometimes 


9 


(32.11) 


8 


(21.1%) 


1. 


385 


No 


2 


( 7.2%) 


5 


(13.1%) 






Yes 


16 


(55.2%) 


16 


(42.1%) 


2 


df. 


Sometimes 


3 


(10.3%) 


5 


(13.2%) 


1. 


126 


No 


10 


(34.5%) 


17 


(44.7%) 







Yes 


23 


(79.3%) 


22 


(57.9%) 


2 df. 


Some til me Q 


c 




1 n 
xu 






No 


1 


(3.5%) 


6 


(15.8%) 




Yes 


12 


(41.4%) 


22 


(57.9%) 


2 df . 


Sometime 


5 


(17.2%) 


5 


(13.2%) 


1.808 


No 


12 


?A1 Ai^ 


XX 


f 0 SI 




Yes 


12 


(44.4%) 


14 


(38.9%) 


2 df. 


Sometimes 


11 


(40.7%) 


10 


(27.8%) 


2.976 


No 


4 


(14.9%) 


12 


(33.3%) 






2 


( 6 91*) 


ti 






Yes 


27 


(93.1%) 


31 


(88.6%) 


1 df. 


No 


2 


( 6.9%) 


4 


(11.4%) 


0.383 


answered 






3 


( 7.9%) 




Yes 


25 


(86.2%) 


29 


(82.9%) 


1 df. 


No 


4 


(13.8%) 


6 


(17.1%) 


0.135 


answered 






3 


( 7.9%) 




Yes 


19 


(65.5%) 


22 


(59 .5%) 


2 df. 


Sometimes 


6 


(20.7%) 


9 


(24.3%) 


0.253 


No 


4 


(13.8%) 


6 


(18.2%) 




answered 






1 


( 2.6%) 




Yes 


13 


(72.2%) 


17 


(68.0%) 


2 df. 


Sometimes 


0 1 


C 0.0%) 


5 


(20.0%) 


5.027 


No 


5 1 


[29.8%) 


3 


(12.0%) 




applicable 


111 


[37.9%) 


13 


(34.2%) 




Yes 


9 1 


[50.0%) 


9 


(37.5%) 


2 df. 


Sometimes 


3 { 


[16. 6%) 


9 


(37.5%) 


2.188 


No 


6 1 


[33.4%) 


6 


(25.0%) 




applicable 


111 


[39.9%) 


14 


(36.2%) 




Yes 


22 ( 


78.5%) 


30 


(79.0%) 


2 df. 


Sometimes 


2 ( 


' 7.3%) 


2 


( 5.3%) 


0.1183 


No 


4 ( 


14.2%) 


6 


(15.7%) 




answered 


1 ( 


: 3.5%) 
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26. Do you can roe at, 
fruits, or 
vegetables? 

27. Do you have a 
library card? 



28. Do you use a 
library? 



Response 
Categories 

Yes 

Sometimes 
No 

Yes 
No 

Not answered 
Yes 

Sometimes 
No 

Not answered 



29. Do you yourself read 
letters from Yes 
relatives and No 
friends? 



Control Treatment Chi -square 

14 (48. 3t) 19 (SO. 01) 
1 ( 3.51) 2 ( 5.3*) 



14 (48.21) 17 (44.71) 

5 (17. 2t) 7 (18.91) 

24 (82. 8t) 30 (81.lt) 

1 ( 2.61) 



2 df. 
0.175 



5 (17. 9t) 7 

6 (21.41) 5 
17 (60.71) 25 

1 ( 3.51) 1 



(18.91) 
(13.51) 
(67.61) 
( 2.61) 



23 (79. 3t) 36 (94. 7») 
6 (20.71) 2 ( 5.3*) 



1 df. 
0.030 



2 df. 
0.715 



1 df. 
3.723 



30 



31 



32 



Do you write 
letters to rela- 
tives ^ friends? 



Yes 
No 

Not answered 



Do you write to Yes 
your government No 
representatives? Not answered 

Do you write Yes 
letters of complaint? 

Sometimes 

No 



33. Do you use a 
dictionary? 



Yes 
No 

Not answered 



34. Do you or your Yes 

spouse make menus Sometimes 

for the day or No 

week? Not answered 



35. Do you read the ad- 
vertisement before 
you go shopping 
for groceries? 

36. Have you filled out 
work application 
forms in the 

past year? 



Yes 

Sometimes 



Yes 
No 



21 (75.0*) 28 (82.41) 

7 (25.01) 6 (17.6%) 

1 ( 3.51) 4 (10.51) 

7 (25. Ot) 9 (23.7%) 
21 (75. Ot) 29 (76. 3t) 

1 ( 3.5t) 

8 (27. 6t) 5 (13. 2t) 

5 (17. 2t) 9 (23. 7t) 

16 (55. 2t) 24 (63.lt) 

24 (82. 8t) 31 (86.lt) 

5 (17. 2t) 5 (13.9t) 

2 ( 5.3t) 



4 (14. 8t) 
7 (25. 9t) 
16 (59. 3t) 
2 ( 6.9t) 



4 (10. 5t) 
12 (31. 6t) 
22 (57. 9t) 



16 (55. 2t) 23 (60. 5t) 
5 (17. 2t) 8 (21.lt) 
8 (27. 6t) 7 (18. 4t) 



11 (40. 7t) 12 (32. 4t) 
16 (59. 3t) 25 (67. 6t) 
2 ( 6.9t) 1 ( 2.6t) 



1 df. 
0.5010 



1 df. 
0.016 



2 df. 
2.267 



1 df. 
0.1388 



2 df. 
0.4134 



2 df. 
0.821 



1 df. 
0.468 
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41. 



42 



Response 
Categories 

Yes 
No 

Not answered 
Yes 

Sometimes 
No 

Yes 

Sometimes 
labels on medicines, No 

Soisons and other Not answered 
ome chemicals? 



Control Treatment Chi -square 



37. Do you have a 
driver *s license: 



38. Do you vote? 



39. Do youkkeep and 
read identifying 



40. 



Do you know the 
difference between 
fact and opinion 
in politics and 
other crucial 
areas of concern? 



Yes 

Sometimes 
No 

Not answered 



Do you listen with 

purpose to radio Yes 

Q TV news and Sometimes 

information No 

programs? Not answered 



Do you keep a 
simple family 
budget? 



Yes 
No 

Not answered 

Yes 
No 

Not answered 



43. Can you determine 
the price of a 
single item when 
the article is 
being sold in sets 
of 2,3,4, and 5? 



44. Can you use the Yes 
index of a book to No 

find specific Not answered 
information? 

45. Do you know how to Yes 

seek advice and Sometimes 

action from local. No 

state and national Not answered 

agencies? 



17 (60. 7t) 
11 (39.31) 
1 ( 3. SI) 

17 (58. 6t) 
4 (13.81) 
8 (27.61) 

26 (92.81) 

1 ( 3.61) 

1 ( 3.61) 

1 ( 3.51) 



8 (28.61) 

9 (32.11) 
11 (39.3%) 

1 ( 3.5%) 



23 (82.1%) 

4 (14.3%) 

1 ( 3.6%) 

1 ( 3.5%) 

16 (59.3%) 
11 (40.7%) 

2 ( 6.9%) 

23 (85.2%) 
4 (14.8%) 
2 ( 6.9%) 



20 
17 
1 

25 
3 
10 

37 
1 
0 



12 
14 
12 



31 
6 
1 



20 
16 
2 

31 
7 



28(100.0%) 34 

0 ( 0.0%) 4 

1 ( 3.5%) 



22 (78.7%) 24 

2 ( 7.1%) 7 

7 (14.2%) 7 
1 ( 3.5%) 



(54.1%) 
(45.9%) 
( 2.6%) 

(65.8%) 
( 7.9%) 
(26.3%) 

(97.4%) 
( 2.6%) 
( 0.01) 



(31.6%) 
(36.9%) 
(31.5%) 



(81.6%) 
(15.8%) 
( 2.6%) 



(55.6%) 
(44.4%) 
( 5.3%) 

(81.6%) 
(18.4%) 



(89.5%) 
(10.5%) 



(63.2%) 
(18.4%) 
(18.4%) 



1 df. 
0.288 



2 df. 
0.692 



2 df. 
1.439 



2 df. 
0.425 



2 df. 
0.072 



1 df. 
0.086 



1 df. 
0.146 



1 df. 
3.138 



2 df. 
2.218 



84 
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Response 
Categories 



Control Treatment Chi -square 



Yes 


17 


(65.41) 


20 


(58.8%) 


1 df. 


No 


9 


(34.61) 


14 


(41.2%) 


0.258 


Not answered 


3 


(10.4%) 


4 


(10.5%) 




Yes 


1 


( 3.61) 


5 


(14.7%) 


1 df. 


No 


27 


(96.4%) 


29 


(85.3%) 


2.178 


Not answered 


1 


( 3.5%) 


4 


(10.5%) 




Yes 


28 


(96.6%) 


32 


(84.2%) 


2 df. 


Sometimes 


0 


( 0.0%) 


3 


( 7.9%) 


3.114 


No 


1 


( 3.4%) 


3 


( 7.9%) 





46. Do you keep and 
balance a bank 
checking account? 

47. Do you figure and 
complete your own 
income tax forms? 

48. Do you read and 
question documents 
before signing your 
personal signature? 

49. Do you get along 
well at work with 
fellow workers and 
do you carry out 
instructions well 
on the job? 

50. Have you been 
improving your 
job skills? 

51. Have you sought 
advanced skills 
(vocational school 
programs) ? 



Results; The tabled values of for 1 df and 2 df are 3.841 
and 5.991 respectively to reject the null hypothesis at 0.05 
level of significance. Scanning the calculated values of Chi- 
square in the last column indicate that none of the 49 hypotheses 
tested at 0.05 level can be rejected. In other words, the 
responses of the control and the treatment groups when categorized 
as shown in the data do not reflect any differences with a prob- 
ability of 0.9!). 

Since the statistical tests do not show any difference in the 
control and the treatment groups, a comparison of the description 
of responses in Questions 9, 10 and 11 was not considered useful. 



Yes 


19 


(86.4%) 


24 


(85.8%) 


2 df. 


Sometimes 


1 


( 4.5%) 


2 


( 7.1%) 


0.197 


No 


2 


( 9.1%) 


2 


( 7.1%) 




Not answered 


7 


(24.1%) 


10 


(26.3%) 




Yes 


15 


(62.5%) 


18 


(58.1%) 


1 df. 


No 


9 


(37.5%) 


13 


(41.9%) 


0.111 


Not answered 


5 


(17.2%) 


7 


(18.4%) 




Yes 


12 


(44.4%) 


10 


(27.0%) 


2 df. 


Sometimes 


0 


( 0.0%) 


2 


( 5.4%) 


3.197 


No 


15 


(55.6%) 


25 


(67.6%) 




Not answered 


2 


( 6.9%) 


1 


( 2.6%) 
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In conclusion, the results show the comparative effect of 
the Home Visitors only, which have been concluded as non- 
significant. However, these results do not say anything 
regarding the effectiveness of TV and the Content Center 
part of the RFD program, since both the groups had access 
to the TV and Content Center parts. As has been emphasized 
in Evaluation Report using Wisconsin Adult Basic Test 
Battery, it is quite possible (and there are indications 
from other reports) that TV component and Content Center 
component effected both the groups significantly and equally, 
but massive changes could not be brought about in further 
change in the treatment group by introducing Home Visit 
component . 
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Gentral Sumnary 

Introduction 

Project RFD Is a demonstration project In Adult Basic Education 
funded under the provisions of Section 309(b) of the Adult Education 
Act of 1966. The project has operated during the 1970» 1971* and 
1972 fiscal years with a total funding of $708»000. The project has 
operated at the University of Wisconsin - Extension which Is In Madison, 
Wisconsin. 

The external evaluation was conducted by a team of five persons 
from Colorado State University, Fort Collins, Colorado. The evalu- 
ation work was funded by project monies with a sub-contract written 
between Colorado State University and the University of Wisconsin. 
The contract was made on the basis of a proposal submitted by the 
team to a Request for Proposal for evaluation Issued by Project RFD. 
This report presents the findings and judgments of the team. 

The following persons were the team members: all from Colorado 
State University. 

Mr. Preston Davis, Director, Office of Educational Media 
Dr. Mary Helen Haas, Professor of Vocational Education 
Dr. Ronald Wykstra, Professor of Economics 
Dr. Henry Cross, Professor of Psychology and co-director of 

the evaluation study. 
Dr. Douglas Sjogren, Professor of Education and co-director 

of the evaluation study. 

A considerable amount of description of the project Is Included 
In this report. It Is recommended, though, that the person who wants 
In-depth descriptive Information obtain copies of the reports listed 
In the reference list at the end of this report. 



Purpose and Method of the Evaluation Study 

Our perception of the purpose of the External Evaluation study was 
that of validation. The primary concern seemed to be one of having 
an Independent group of knowledgeable persons observe, study, and make 
judgments about the project with respect to Its Internal operation 
and Its potential application. Such judgments have been made by the 
Project RFD staff on the basis of Information gathered In a quite 
comprehensive Internal evaluation effort. The question for the external 
evaluation then Is whether an Independent group will arrive at the same 
judgments using essentially the same Information base. 
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The overall purpose of the external evaluation Is reflected In the 
six purposes stated In the call for sealed bids Issued by the project. 
The purposes, listed below, served as the objectives of the external 
evaluation study. 

1. To review the accomplishments of the project In design, field 
testing, and evaluation. 

2. To assess the extent to which the project achieved Its objectives. 

3. To assess the extent to which data collection has been adequate 
to the requirements of the research. 

4. To assess and make judgments about the design and execution 
of the internal research. 

5. To relate cost to accomplishments. 

6. To prepare a report that will be readily Incorporated Into the 
final project report. 

The team operated much like an accrediting team. Much of the 
Information for the evaluation study was In the form of reports 
Issued by the Project RFD staff. They have done a good job of pre- 
paring descriptive narrative reports of tie project as It has proceeded. 
The narrative not only describes what occurred, but ^^Iso Includes 
the rationale for the decisions that were made. 

The Psychometric Laboratory at the University of Wisconsin did 
the Internal evaluation for the project. The lab has produced several 
reports on various aspects of the project. These reports were avail- 
able to the team, and provided valuable Information for the external 
evaluation. 

Members of the team visited the project and interviewed many 
people who were associated with the project. A total of 10 man-days 
were spent on the site by the team and about 50 persons were inter- 
viewed. Those Interviewed included project staff, former staff, 
participants, ABE personnel, advisory committee members, and several 
persons in the University hierarchy. The information obtained 
In the interviews was an important supplement to that available In 
the reports. 

During the time of the study, the team met several times to review 
the information that had been obtained, and to decide on information 
needs. These meetings permitted the team members to check their impres- 
sions against the others, and to stimulate the thinking of the team. 
Generally, the team meetings occurred before and after a member or 
members visited the project. 

From a methodological point-of-view we felt that having all 
the evaluation team members from one institution facilitated the study. 
We were able to interact quite often over a period of time. This seemed 
to help us to clarify our thinking and chc.k our perceptions of the 
project. 
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This rtport then Is of our judaments of the project. The first 
section of the report contains a brief description of the project 
and a summary statement on the attainment of the project goals. The 
subsequent sections are essentially critiques of the conceptualiza- 
tion, development and operation of each of the components of the project. 
The final section Is a cost analysis of the project. 



Overview 

Project RFD was conceived as a method or model for delivering 
educational opportunity to the rural adult. More specifically the 
project proposed to deliver educational opportunity to the rural 
adult who Is undereducated. I.e. Adult Basic Education. Essentially 
the project was a demonstration and test of two related Ideas. First, 
It was a demonstration and test of a delivery system that might 
have many kinds of application. Second, It was a demonstration and 
test of materials designed to provide educative experiences for 
undereducated adults. 

The needs for the delivery system and for the educative experiences 
were quite well documented In the first proposal. Furthermore, the 
rationale for the model and for the experiences seemed to be sound. 
The proposed demonstration and test was well -conceptualized and 
seemed to have a reasonable probability of success even though It should 
be considered a high-risk type of project. The models are detailed In 
references one and two. 

The fidelity of the project as It was conducted with Its conceptual 
Izatlon was fair. Several changes were made In both of the basic 
Ideas from conceptualization to operation. The basic Ideas, 
however, <i1d persist and the project as conceptualized was certainly 
recognizable In the operation. 

The critiques of each component present specific detail on the 
changes from conceptualization to operation. A summary of the 
changes Is presented here for those readers who only want an over- 
view. 

Quoting from the first-year proposal the original goal of the 
project was: 

"Development of a... rural adult basic education and continuing 
education demonstration and research project utilizing .educa- 
tional television. Individualized home study Instruction tech- 
niques, and a personalized home contact Instruction and evalu- 
ation plan.... 

...By combining these three elements, the University and State 
of Wisconsin propose to demonstrate a new approach to providing 
adult basic education courses for the rural disadvantaged." 
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The television component was regarded as the "basic Instructional 
and motivational tool *. The half-hour programs were to be designed "to 
Introduce educational concepts of Importance to the entire student 
group and to motivate the student prior to the programmed, variable- 
speed, home study phase of the Instruction." 

The home study component was Intended to consist of materials 
that would be used by the student In his home setting much In the 
nature of correspondence courses. They were to be designed so 
that the student could proceed at his own pace. Several areas of study 
were Intended Including basic literacy, family life and consumer 
education, social relations, conservation, enjoyment of life, and 
others. The materials were to be for those with elementary level read- 
ing skills. 

The home-contact component was Inte.iued as a procedure for 
Instructing, motivating and counseling, and for evaluation of the 
student's progress. The "Home Study Aide" was to provide direct 
Instruction. 

In the Ideal sense, the Intent was that a student would view a 
TV program that would provide some basic Instruction and stimulate 
Interest. Then the student would receive the home-study materials 
that were appropriate. The home visitor would Interact with the 
student weekly and answer questions. Instruct, counsel, and provide 
Incentive for persisting In the program. 

The first year of the project was devoted to the development 
of the materials and procedures for operational 1 zing the demonstration. 
Several decisions were made during the first year that resulted In 
changes In the conceptual design. The three main components; tele- 
vision, home-study, and home visit were still Included and some new 
components were added; an action line, a newspaper or almanac, and 
a radio show. 

The Intent for the television component changed somewhat. Surveys 
were conducted on viewing likes and dislikes. On the basis of the 
surveys and careful consideration of the potential of television. It 
was decided that the TV component would be designed to serve pri- 
marily In a motivational function. A "magazine show" format was 
developed for the twenty half-hour programs that were used In the 
demonstration. The shows contained Interviews with personalities, help- 
ful hints on buying, cooking, home repair, etc., and short spots on 
topics like conservation. Insurance, social security, etc. 

The home study component changed considerably during the first 
year. On the basis of surveys and consultation two major decisions 
were made. First, the emphasis changed. Whereas literacy skills 
were emphasized in the original proposal, the Intent of the home 
study materials after the first year of work had changed to a 
broader concept of literacy. The primary emphasis shifted to materials 
on what were called coping skills. 
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Coping skills wert dtflned as the skills and knowltdat nttded 
to interact effectively In one's environment. It was decided that 
materials would be made available In five general areas called 
content centers. The content center topic areas were entitled, 
"About Me", "About Me and Others", "About Mc and My Money", 
"About My Work", and "Me and My Community. Materials on the 
usual literacy skills, the three R's, were to be available still, 
but only on specific request or on a decision made by the student 
with the home visitor. 

The second major decision was with respect to assumptions about 
the reading level of the coping skills materials. The original plan 
was to develop materials for reading levels 0-8. Actually, it 
was Intended that the materials be written at three levels roughly 
equivalent to K-2, 3-5, and 6-8. On consultation, It was decided 
to prepare only one set of reading materials with a reading 
equivalency of about grade 5. This decision was probably a good 
one from the practical viewpoint in that it reduced the amount of 
materials that had to be produced. On the other hand, the decision 
did compromise the original Adult Basic Education objective somewhat. 

The conceptualization of the home visit component also changed 
during the first year planning period. The intent that the home 
visitor would be a motivator, counselor, and friend was maintained 
but the instructional function of the home visitor was de-emphasized. 
One fact about the home visit component became obvious during the 
planning year. This was that there was a very real limit on the 
number of home visits that could be made. It was decided that the 
home visit component would be used with 50 persons In the demonstration. 

With respect to the action line, almanac, and radio show. It Is 
not clear from the reports just when these were conceptualized. The 
action line component Is described In the second year report and Is 
rationalized as a feedback linkage between the participant and the 
program. The learner audience had a direct communicative link with 
RFD and the members were provided a means for solution of personal 
problems. 

The purpose of the almanac is not clearly enunciated In any report. 
It appears to have been designed as a motivational device In that 
It Is a p»*ocedui'e for regular contact with the audience. The speci- 
fic need for which it was designed is not clear to us, however. 

The radio program is not described either. Apparently its 
purpose was to do some of the same things as the TV programs in 
homes where there was no TV. We feel this medium might have been 
used more than it was. 



^94 



The second year of the project was the development and demon- 
stration year. The twenty TV tapes were produced, the home study 
materials were selected and/or written, the home visitors were 
hired and trained, the evaluation procedures were developed, and 
the sa.iip1e for the demonstration study was selected. All was 
supposedly In readiness for the demonstration study by January 1. 
There was some slippage, however, and although the demonstration 
study started on schedule. It was hampered by the fact that all was 
not ready. 

Actually there were two demonstration studies. One study was an 
experiment In which two random samples with an N of 50 In each were 
drawn from a population of an Identified target audience In the four 
counties served by WHA-TV. One sample, hereafter called the treatment 
group, had access to all components. The received the TV programs, 
received the home study materials, had home visitation, and had 
access to the action line, almanac, and radio program. The other 
sample, the control group had access to every component except the 
home visitation. Iha sampling procedures were such that this 
stu4y appeared to be a well -control led experiment In which the 
independent variable categories were having or not having home 
visitation. The critique of the design section of this report Indi- 
cates some of the problems that were encountered in this study. 

The second demonstration study was done with the rest of the popu- 
lation In the WHA-TV viewing area. The entire population had access 
to every component but the home visitation. Extent of participation 
was studied. This study Is also critiqued In the design section 
of this report. 

The third year of the project has been devoted to analyzing and 
reporting the evaluative information, revising and writing materials 
for national dissemination, conducting dissemination activities, and 
planning next steps. 

Was Project RFD successful? It has been said In many ways that 
there are many sides to truth. So It Is with RFD. It was not a 
failure nor was It the success some might have hoped. Some things 
were done very well, some things were not done at all as expected. 
A model was implemented and educational experiences were delivered, but 
the model is not, r;cr should It be expected to be, the final solution 
to adult education. 

• A reading of the critique sections will reveal the specific 
reasons for our middle-of-the-road conclusions. As a conclusion 
to this summary statement, however, we have reviewed each of the 
original objectives of the project and offered our judgment of the 
extent to which the objective was attained. 
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Objective One - Demoifistrate the effectiveness of an Integrated te1e« 
vision t home study, home contact and visit program for rural ABE students . 

This objective was really the overall aoal of the projec';. 
This objective was attained to some extent In that the project did 
develop and carry through a method for delivering educational activities 
to adults. Furthermore, the delivery system did Include all the com- 
ponents. 

Three key words In this objective are "effectiveness". "Inte- 
grated" and "rural". An attempt was made to Integrate the components, 
but the Integration was not effected well In the demonstration. There 
was little evidence that the TV programs were designed to stimulate 
Interest In materials In the content center. The home visitors and 
the participants with whom we visited saw little or no correlation 
among the three components except for the home visitor helping the 
participant obtain materials. The TV programs did Include spots 
where materials In the content center were mentioned and Information 
was provided on how to obtain the materials. New materials were 
described each week, however, and It Is unlikely that the participant 
In the target audience would be ready for new material on a weekly 
basis. Also any single TV program did not reveal all of the materials 
that were available so the participant was not really aware of all 
of the alternatives. Of course, those participants who had the 
home visitor were likely made aware of the alternatives by the home 
visitors. The TV programs were very much designed with a "soft-sell" 
approach, perhaps too soft. 

The project did many things to stimulate contact between the 
potential participant and the project, and these activities did serve 
an Integrative function. The action line, post card contacts, and 
the extensive publicity in tf.w project did serve to Increase awareness 
of the many things that Project RFD had to offer. 

Our judgment with respect to the Integration attempt Is that 
the project staff made a concerted effort to achieve Integration of 
the components, but were not as successful with this Intent as might 
have been desired. They did learn much about the problem of Inte- 
grating multl -media approaches. 

The second key word Is effectiveness. This word Implies some 
criteria which are not specified In this objective. The criteria 
are suggested, however, by some of the other objectives, and the 
discussion of those objectives suggests the extent of effectiveness of 
the project. In summary, the project did have a high level of 
participation in the four county area. There Is some question, however, 
whether the participation rate was high In the target audience. 
Many people requested materials. The requests for materials were 
significantly higher In the group that had the home visitor than 
In the control group or the rest of the population. The home visit 
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component apparently was effective In getting educational materials 
Into the hands of the participant. There was little evidence, however, 
that there was any change In skill, knowledge, or attitude due to 
the project or any of Its components. 

The last key word Is rural. The project was originally designed 
for a rural audience. This Intent was not maintained, however, and 
the project was really for the total population. In fact. It 
appeared that In terms of absolute numbers and also proportionately, 
the participants generally were from the metropolitan area of 
Madison. Furthermore, the 100 subjects In the experiment were pri- 
marily from towns In the area rather than from farms. This does not 
Indicate that the delivery system and materials would be Ineffective 
with a rural audience. We still don't know. 

On a 5 point scale of attainment, with 5 Indicating a high degree 
of attainment, we rate the attainment of this objective at 3.0 to 3.5. 



Objective Two - Demonstrate the effectiveness of the role of mass 
media In rural ABE programs. 

This objective Is not clear to us, again because of the terms 
"effectiveness", "role", and "rural". We have addressed the problems 
with the terms effectiveness and rural in the discussion of the first 
objective. The term "role" Is problematic because there Is no 
deiinltlon of just what the role Is conceived to be. 

If the role of mass media Is to stimulate and motivate, then 
there Is some evidence that this occurred. Many people watched 
the programs. A large majority of those who watched liked the 
programs. Many of the watchers were stimulated to contact the 
project for materials. These observations do Indicate that 
assigning a stimulation role to mass media Is effective. 

With the definition of the role used here and disregarding the 
rural audience Intent, we rate the attainment of this objective at 3.5 to 
4.0. 

Objective Three - Create a viable television-based multi-media program 
us able in similar situations in other parts of the country . 

The project did create and demonstrate a television-based multi- 
media program. They have also developed a plan for use of the model 
in other areas along with cost estimates. The rationality or feasi- 
bility of the model is attested to by the fact that several states and 
other agencies have indicated an interest in using all or parts of the 
model. The project staff certainly believes the model is viable. 
They have developed a proposal to implement the model in a career 



;97 



-9- 



tducatlon program. Many persons whom wa Interviewed In the University 
and who were not directly associated with the project. Indicated a 
feeling that the model seemed to have promise as a method for the 
outreach function of the University. 

The viability of the program In other situations Is very much 
related to costs. The cost of the television and materials components 
would be reasonable If they are used by a large number of people 
over a period of time. The cost analysis of the project snowed the 
fixed costs of these two components to be quite high but If the 
costs are amortized over a number of people and over time they are 
relatively low per unit. The same Is true of the almanac and the 
radio show. The fixed costs for the home visit component are quite 
high as are the variable costs. This component Is expensive and Its 
cost Increases proportionately to time and persons served. The action 
line component was relatively Inexpensive In the project because of 
volunteer help. If the labor costs for action line were to have been 
real It likely would have been quite costly. 

The general Izablllty of the materials Is another Issue with this 
objective. The TV programs produced for RFD are not general liable. 
They contain specific references to events and places In Wisconsin. 
On the other hand, there are parts of each tape that might be used 
In other situations. The staff of the project has studied the Issue 
of general Izablllty. Their position now seems to be that spots or 
short sequences might be developed for general distribution, but 
that the total program should be put together so that It uses local 
talent and references. It should be evident that the 
general Izablllty Issue Is related to costs. It also may be related to 
effects. A general tape would be usable In many situations and over 
a period of time so that Its cost could be amortized to a relatively 
low cost per unit. Specific tapes would have to be done over 
so that production costs would Increase as well as unit amortization 
costs. On the other hand, specific tapes might be more effective 
than general tapes In attracting and holding audiences. There Is 
likely an optimum balance but what that point might be Is not known. 

The home study materials seem to be general Izable to many 
situations. They do not contain specific references, and the topics 
are quite general. A publishing house has contracted to publish 
much of the material for general Izablllty of the home study materials. 

Our attainment rating of objective three Is 3.5 to 4.0. 

Objective Four - Demonstrate the effectiveness of an interdisciplinary 
family and community oriented approach to rural ABE programs . 

The effectiveness Issue rears Its ubiquitous head again. The 
materials were Interdisciplinary in that they were on topics that were 
quite general and invoh'ed principles from several bodies of knowledge. 
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Tht materials were also family and comnlty oriented In that they 
dealt with concerns of everyday life: work» the family, the home, 
money, etc* The project did demonstrate effectiveness in this 
area In the sense that materials could be developed with the family and 
community orientation. Furthermore, the materials seem to be 
rational, accurate. Informative, and' Interesting. Unfortunately 
there Is little evidence on their effectiveness with respect to 
participant behavior. 

Our attainment rating for this objective Is 3.0 to 3.5. 



Objective Five -Involve large numbers of undereducated adults not now 
able or willing to participate In ABE programs. 

It Is difficult to determine just how many undereducated 
adults did participate In the program. From one polnt-of-vlew It 
could be argued that every adult who contacted RFD was undereducated 
In some degree. They had a need or want for Information and Ini- 
tiated action to obtain It. Some 3,000 adults did contact RFD for 
something during the five month demonstration. This Is a large number. 

Undereducated usually connotes a person with little education, 
however. Excluding the 100 persons In the experiment, the 
available figures suggest that about 15% of the contractors were 
Individuals with less than an eighth grade education. This 15% 
figure Is very near to the percent of persons with less than an 
eighth grade education In the four county area. The program did 
not attract a disproportionately large number with little education, 
but It also did not have a disproportionately small representation 
from this educational category. The typical situation Is that 
educational programs will attract persons with education and those 
with little education are notable In their nonpartlclpatlon. 
Project RFD seems to have broken t!iis pattern somewhat. We 
would predict that If the demonstration had operated for longer 
than five months, the participation rates of the typical undereducated 
adults would have Increased. 

The experimental study had some Interesting results In terms of 
Involvement. The 50 persons In the treatment group persisted well 
In the project. There were 12 drop-outs but 8 of these were In the 
last month. The reasons for drop-outs were generally like moving, 
working full-time, or family problems. There were two refusals. 
The treatment group had a high rate of participation In terms of 
viewing the programs and using the materials. Those In the control 
group had a higher rate of participation than the general population 
but not as high as the treatment group. Two conclusions a^^e suggested: 



1. The special attention given the control group during the recruit- 
ment phase seemed to stimulate them to parclclpate even though 



thty did not havt tht homt contact. This result suggests that 
some form of a stated commitment Is conducive to participation 
and persistence. For example, enrollment procedures are a form 
of a commitment that might have a beneficial effect. 

2. The home contact component was effective In stimulating 
Involvement and participation. Exposure to education Is 
an Important first condition. In the five month demonstration, 
the home contact component had a positive Impact on exposure. 
Furthermore, the efforts expended In publicity and adver- 
tising by the project seemed to have a pay-off In terms 
of Involvement. 

We feel this objective was well -attained and our rating Is 4.0 to 4.5. 



Objective Six - Develop a program that will Improve ABF Instruction 
while maintaining the lowest possible cost-per-pupll . 

We feel this was an unrealistic objective, especially the aspect 
of "lowest possible cost-per-pupll". A demonstration project will 
usually not operate as efficiently as It could. Thus, the cost-per- 

gupll was quite high. Some comparisons are available. A home- 
ased ABE program that provided four hours of Instruction per week 
for four months to about 100 students had a cost per student of about 
$185. A rough allocation of project costs indicated that the cost- 
per-student for the treatment group was about $2,400- It must be 
recognized of course, that there were some 2,900 other persons who 
received some benefit and their cost was about $200 per student. 
Furthermore, these costs would be reduced considerably as the program 
was re-run. Even so the cost-per-pupll was high as would be expected. 

There Is no real evidence that the program Improved ABE 
Instruction. Materials were developed that appear to be useful 
and they were used. Whether they were an improvement Is not known. 

An objective like this one Is nice to have, but, as stated. Is 
quite unrealistic. We have to rate the attainment of the objective low, and 
the rating Is 1.0 to 1.5. 



Objective Seven - Assist in the development of skills that can lead 
to new careers for home-study aides anu other staff members." 

In contrast to Objective Six, this objective was realistic. The 
project was not committed to development of new careers. Rather the 
very realistic intent was that the staff would learn things that 
might lead to new careers. 

Although all of the staff members were considered in the 
objective. It is probably correct to assume that the objective pertained 
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primarily to the home study aides (home visitors). The home visitors 
did receive a considerable amount of training prior to and 
during the demonstration. Some dissatisfaction with the training was 
expressed by the home visitors. They felt they should have been 
able to function more as a teacher than they did. The teaching 
role was not regarded as the proper role by the project, however. 
Consequently, the training was oriented to the home visitor being 
able to establish a helping relationship with the student, and to 
knowledge of resources that were available for the student. The 
home visitors did Indicate that they were well-trained In these areas. 

It Is Important to note that at the end of the project two of 
the home visitors were hired In one of the counties to dc those 
things they had done In the project for an Area Vocational-Technical 
school. Thus, even though there was no job description In any agency 
for a person with home visitor skills. In one county they did regard 
this function to be important enough to find a way to create such a job. 

We rate the attainment of this objective 3.5 to 4.0. The 
rating might have been higher, but we judged that there were some 
roblems with the training such that the role definition for the 
ome visitor was not as clear as it might have been. 



Objective Eight - Demonstrate Involvement of disadvantaged Individuals 
in the development and implementation of such a program. T 

The project did solicit and receive Input from disadvantaged 
adults in the planning and development stages. The Inputs were In 
the form of Interest surveys, TV viewing Interest surveys, and 
reactions to materials. These efforts were Important In that they 
did provide good Information as a basis for some of the Important 
decisions. 

The word "Involvement" Implies more to us, however, than being 
an Information giver. The word connotes things like commitment. 
Interaction, and participation In decisions. We don't feel this 
kind of Involvement was evident. The project exhibited a fault we 
feel is present In too many of our educational programs. Typically 
we do a needs assessment (formally or informally) and then we 
interpret the results and decide on a program that will do something 
to or for somebody else. That somebody else is not involved In the 
interpretation and decision making. As a consequence the program Is 
perceived by the participant as "their program" rather than "ours". 
We criticize RFD in this sense. Disadvantaged individuals were not 
represented on the advisory committee. Some did sit on a field advisory 
board but this board did not seem to have functioned very well. 
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None sat-ln on any of the decision making sessions. Of the participants 
with whom we visited the tone was» "It was nice that the University 
(or government) did this for us", rather than one of really Identifying 
with the project as "ours". 

The almanac and the various feedback procedures were probably 
attempts to obtain Identification with the project by participants. 
They may have had some effect In this way. Our Impressions based on 
conversations and the obvious resistance to being Interviewed by many 
at the end of the project, however, were that the target audience did 
not have a perception of being Involved In the project except as a 
recipient of favors. 

Our rating of attainment of this objective Is 3.0 to 3.5. 



Objective Nine - Develop participant skills In the basic fields of 
communication and computation while improving the capability of the 
target audience to exercise citizenship responsibilities. 

This objective Is the critical one for many of the people who 
will judge the RFD project. The project was funded as a demonstration 
In Adult Basic Education. Therefore, It should give evidence that It 
delivered Adult Basic Education. Unfortunately there Is no strong 
evidence that >he project met this objective very well. In the 
critique of the design, we have indicated some of the reasons perceived 
by us for the project not attaining this objective. These reasons are 
summarized here. 

1. This objective changed after the project started. Whereas 
the emphasis at first was on communication and computation 
skills. It changed to an emphasis on coping skills. If 
one equates "citizenship responsibilities" with coping skills, 
then the objective as It actually was can be reworded as 
follows: 

"Develop skills of the target audience In coping with their 
environment while providing the opportunity to Improve In the 
basic fields of communication and computation." 

In our judgment, even this objective stresses the communication 
and computation areas more than they were actually stressed 
In the demonstration. The project reports state that study 
materials were available In the literacy areas, but they 
were not pushed, and there Is little evidence that such 
materials were requested or used. The TV programs generally 
mentioned only the coping skill materials, and the order form 
for materials Included nothing In terms of literacy. The last 
few TV programs did make some mention of the possible availability 
of some literacy materials. In fairness to the project. 
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It should be noted that one reason these materials were 
not mentioned was because of a concern that a large number 
of parents would order them for their children. 

One of the main criticisms of the project that we heard in our 
Interviews was that the project erred when it de-emphasized 
the literacy training as much as it did. The point made 
was that while the coping skills are important, the basic 
three R's are also important, and that the project should have 
persisted with the original objective in this area. We 
feel this criticism has some merit. 

The design used in the evaluation was not especially appropriate 
to the objective. Actually, the main evidence of relevance 
to this objective is from the controlled experiment. On four 
general criterion measure areas (three of which were content- 
oriented) there were no significant differences at the .05 
level between the treatment and control group means. Recall 
that the treatment difference was having or not having a 
home visitor. There is less evidence on whether receiving 
and using the materials and viewing the TV program had 
an effect. The only evidence is that the treatment group 
received significantly more materials than the control group, 
but still did not score higher on the criterion measures. 

The demonstration as designed did not optimize the results. 
We feel the readiness of the participants in the experiment 
for an educational experience was over-estimated. It seemed 
that the demonstration was nearly half -over before the home 
visitor had gained enough rapport with many of the participants 
to be able to work with them on educational activities. 

The measuring instruments were based on a large number of 
behavioral objectives that were listed during the first year. 
When the emphasis changed, many of the stated behavioral 
objectives were no longer relevant to the content of the 
materials. It should be noted that the difference between 
the means of the treatment and control group was significant 
at less than the .10 level (one-tail) In favor of the treatment 
group on the one measure that was most relevant to the content 
materials. 

Several errors were made in the operation of the demonstration. 
More than a few of the participants did not have workable TV 
sets for much of the time and others were on the fringe of the 
viewing area where reception was bad. The content materials 
were not all prepared or the supply printed was not adequate 
so that some of the participants in the experiment did not 
receive some of the materials or experienced a long delay In 
receiving ordered materials. 
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There were positive outcomes with respect to this objective. 
The response to the TV programs and the content materials was very 
favorable, and there was a generally expressed feeling that they were 
Informative. The demand for the content materials was high. In 
fact, this demand caused part of the proolem mentioned in point five 
above. The project supply of some of the materials was exhausted before 
it was realized that there was not a supply available for the experi- 
ment participants. Finally, the project did succeed in getting educa- 
tional materials Into the homes. Furthermore, the degree of success 
was related to the degree of treatment. That Is, those with home 
visitors ordered the most materials, those without home visitors but 
who were specifically recruited (control group) ranked second, and the 
rest of the population ranked third. Exposure to education Is the 
first element In education, and the project was successful In exposing 
people to educational activities. 

Our rating of attainment on this objective Is 2.0 to 2.5. We do 
feel that If the demonstration had run for another 13 weeks this 
objective might well have had a higher attainment level because the 
participants were just getting Into educational experiences when the 
project ended. 

Objective Ten - Develop participant skills from present proficiency 
t oward eighth grade and twelfth grade equivalency achievement levels . 

There Is little evidence that this objective was attained. In fact, 
after the planning year decisions were made this objective was 
essentially dropped. No clear effort was made in the demonstration to " 
achieve this objective. 

Our rating of attainment on Objective Ten Is 1.0 to 1.5. 
Summary Statement 

Project RFD was an ambitious effort In all of Its phases; conceptuali- 
zation, development, and demonstration. It was also a pioneering effort. 
Its objectives were also ambitious, and In our judgment the results 
were what would be expected of a first effort at an ambitious undertaking. 
Many things were done well, much was learned, and benefits did accrue 
to participants. On the other hand mistakes were made, there were 
errors In judgment, and the benefits were not as great as the promises. 
Our ratings of attainment of the objectives were such that we could 
give the project a global rating of 2.8 to 3.2 on a five point scale. 
This rating certainly reflects our feeling that the project was not as 
successful as would have been desired, but It also was not a failure. 
The project might be considered a relatively high risk type because 
of Its innovative nature. There was little past history to permit 
strong predictions of Its success, and there was little expertise 
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available to give the experience needed to maximize the likelihood 
of success. A high risk project by definition has a high probability 
of failure. Using this line of thinking Project RFD, as a high risk 
project, should be considered quite successful In that It did not fall. 

The project did demonstrate that a multi-media educational 
approach can be put together and delivered Into the home. The project 
also demonstrated that the participation rate using such an approach 
Is quite high. The project produced materials that were judged to be 
Interesting, informative and general Izable. 

The project staff and others who have been affiliated with the 
project have learned much In the past three years. We strongly urge 
that they be encouraged and supported In their further efforts to 
refine and revise the model. Television, radio, home study, home 
visitors, all of these media should be exploited to expand the educational 
opportunities of adults as well as children. The staff of Project RFD 
and others who were associated with the project have made fine 
progress In learning how to use these media effectively. It would be 
tragic If that experience and knowledge were not put to use In further 
work In this area. 
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The Television Component 

Television was one of the three pr^' ^ components of RFD. In 
the first proposal, the conceptual Izatli 3f the TV component 
seemed to be one of Instruction. That 1b» television was to be 
used as a medium of Instruction. The concept changed during the 
planning year, however. 

A field study was made during the planning year, and the 
results Indicated that the target audience preferred news and public 
affairs type programming and a "magazine" format. Other studies 
had Indicated that TV was effective as a medium for developing 
awareness and stimulating Interest rather than In-depth Instruction. 
The decision was made then to use a magazine show format that was 
designed to stimulate and Inform. Each half-hour program contained 
an average of 25 program segments none of which were longer than 
four minutes. The segments Included presentations by the show 
anchorman, film clips of topics of Interest, Interviews with stars and 
with local persons who had Important Information, helpful hints, 
cooking, and other topics. The second-year report contains a com- 
plete listing of each program. 

Four pilot tapes were made In the first year. These were 
shown to persons like those In the target audience; Head Start parents, 
students In ABE classes and GEO students. The reaction to the four 
tapes was favorable In terms of Interest and their being Informative. 

Twenty black and white tapes were then produced for the demon- 
stration. Each was one-half hour and each used the magazine format. 
During the demonstration, one tape was shown four times each week 
over WHA-TV, a UHF station at the University of Wisconsin. The 
air times were consistent each week and seemed to be appropriate for 
maximizing audience coverage. 

An original goal of the project was to develop basic television 
materials that could be used In a variety of rural situations through- 
out the country. This purpose Implies that the programs should 
not be specific to one locality. The programs that were produced, 
however, were quite specific. They contained names, dates, addresses, 
and phone numbers In the four-county area. Thus the programs could not 
be used outside of the area, nor could they be used again en toto In 
the four county area. The rationale for this decision to make the 
programs specific is not clearly defended In the project material. 
Obviously, It was an attempt to personalize the programs and thus 
stimulate Interest. 

This generality-specificity question Is very Important 1n terms 
of cost and possibly In terms of effects. If a program Is general 
enough that It can be shown In a variety of locations or shown repeatedly 
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In th« sftint location, obviously It will have a lower unit cost. 
On the other hand, it may lose In terms of effectiveness. For 
example, reruns of the same program In one locality would be pro- 
blematic with respect to viewer Interest. The approach that RFD 
seems to advocate Is that some program segments can be produced 
for general distribution, but the program should be put together 
for a specific audience. This approach Is probably realistic If 
an optimum balance of cost and effectiveness can be achieved. 
Obviously, there are many questions about TV programming that need 
to be studied. The decision of Project RFD on the generality- 
specificity Issue reflected an Intuitive answer to a series of 
questions that might well be studied empirically. We do not fault 
the project for the decision. The decision did, however, result 
In their not meeting one objective, that of producing TV materials 
with a high degree of general liability. 

The following are offered as specific points of criticism of 
the TV component. 

1. The programs were viewed by a large proportion of the 
audience. Surveys indicated an estimate of 20% of 
the homes with a TV set on during the viewing times 

did view an RFD program during the week. Furthermore, the 
proportion of viewers who were target audience was consistent 
with the proportion In the general population throughout 
the demonstration. 

This outcome was achieved even though the programs 
were In black and white and were shown over a UHF station. 
The exclusive use of a UHF station might be questioned 
because there were sets that did not have the UHF adaptor, 
and there were parts of the four counties that had poor 
reception of the UHF station. The advantage of UHF was 
programming time and/or cost. If the commercial VHF 
stations had been used, the air time would either have 
been on public service time (poor times usually) or 
been purchased time (high cost). 

2. The reaction to the programs was favorable by those who 
viewed the pilot films and those who viewed the program 

In the demonstration. The programs were generally well-done 
and technically sound. Some specific program points of 
critique are: 

a. The choice of a local well-known personality was 
favorably received. He handled the show well 
and also brought an audience. 

b. The topics were appropriate. There was some feeling 
that there were too many segments In the programs 
which may have been confusing for the target audience. 
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c. Tht $tar stgnwnts were not considered too necessary. 

d. Some of the film clips technically were not well 
done, especially the star segments. Other film clips 
had probably been seen before In other programs and 
thus were not unique to these programs. This might 
have damaged the Impression that the program was 
unique to the audience. 

e. The production, graphics utilization, and writing was 
technically sound but not especially Imaginative. 
This Is probably related to the fact that the 
programs were produced In a relatively short 

period of time. Creativity and Imagination need time, 
f • The RFO logo and theme music came on very often during 
a program and might have caused viewers to think the 
program had ended. 

g. The level of abstraction and vocabulary In some segments 
was quite high for the target audience. 

h. The attempt to Integrate the content of the TV programs 
with the other components was only partly successful. 
There were references In the program to the content 
materials, but one would have to view every program 

to know what was In the content center. Further- 
more, It would be likely that one might soon forget 
the content center reference of an earlier program. 
The Almanac served some purpose of Integration between 
the TV and content centers. The integration Intent 
was only partly achieved. Perhaps strong Integration 
requires that the TV programs be produced on a continuing 
basis with several references to materials In different 
contexts. 

1. The TV productions seemed to have been dominated by 
persons trained In TV. The programming might have 
benefitted from more Input from persons who were 
knowledgeable about education of undereducated adults. 

The project did demonstrate that TV can be used In a multi- 
media approach, and that undereducated adults will participate 
In educative experiences with this model. The programs are 
not general izable, but the model Is. 
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Buying Small Appliances 



Do you know what to look for when buying 

small appHances? 

Many small appliances help a person do 
jobs easier and faster. Stop and think of some 
of the itpplidfices you use for making your life 
more comfortable. You may think of the^e: 
toaster, clock, coffeemaker or iron. Now 
think of a smalt appliance you may not use 
often, such as an electric knife. 

There are many small appliances you can 
buy. Most of them are fairly expensive. Don't 
buy small appliances you won't use often. 
Some appliances are used almost every day. 
Others may be used only a few times a year* 
Before you buy, decide how often you would 
use an appliance. Decide if it is worth the 
price to you. Smalt appitances often do things 
that maior appliances do. For exanr)ple, you 
nriay consider buying an electric frying pan. 
You probdbly do most of your cooking and 
baking on your stove. Because of this, you 
may decide an electric frying pan realty isn't 
necessary for you. 

KINDS OF SMALL APPLIANCES 

There are two kinds of small appliances: 
those that give heat and those that give 
power. A mixer, electric fan or can opener 
gtvH power. An iron, coffee maker and toaster 
give hetit. Some of these appliances will do 
only one thing such as toasting bread or 
mtjktny coffee. Others will do several jobs. An 
exumple ts the uppliunce which can o))en cans, 
crush ice, and shurfHjn knives. It is cheaper to 
buy one jppliuntc that does several things. 
This is true, however, only if you need every 
service that an iifjphunce will do. Otherwise, it 
IS cheuper to buy the appliance that docs the 
one thing you need. 
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Home Study Materials Component (Content Centers) 



The first year proposal gave an Impression that the home study 
component of RFD would be basic literacy materials presented In a 
correspondence school kind of format. If this was the concept then 
It changed considerably during the planning and demonstration years. 
The changes were quite well justified and the home study concept 
that evolved In the project seems to be a sound approach. 

Several things happened with respect to the home study component 
during the first year. One of the first decisions was that a sequential 
type curriculum was not appropriate for the target audience. Thus, the 
Idea of having a person progress through traditional graded materials 
was rejected. Related to this decision was a second one that the 
materials should be Immediately relevant to the needs, wants, and 
Interests of the undereducated adults. The materials should be 
concerned with solving problems of the adult rather than teaching 
literacy skills per se. Of course, the expectation was that 
the study of relevant materials would also provide literacy skill 
tk-alning Indirectly. It should be noted that the term "coping skills" 
was used to describe the aim of the content. A survey was made of a 
sample from the target audience. The results tended to substantiate 
the decision to orient the content to coping skills. 

A model of the content component concept Is In the first year 
report. According to this model, the primary content was directed 
at the coping skills. Materials on literacy skills, computation 
and communication skills, were available If the student Identified 
a need for or Interest In working In these areas. 

A third decision made during the first year was to develop the 
materials for a reading level of grade four to six. Originally the 
Intent was to develop materials so that the reading levels of 0 
to 8 would be covered. This probably would have been done by writing 
the same content at three reading levels like 0-2, 3-5, and 6-8. 
The decision was certainly justified from the practical viewpoint, but 
It did somewhat compromise the Adult Basic Education intent of the 
project. 

Another activity of the first year was developing behavioral 
objectives. A large number of such objectives were Identified. We 
are confused about when this task was done or why It was not done 
over. A reading of the objectives In the first year report will 
reveal that a large proportion of them are stated In terms of 
improving literacy skills. Yet the emphasis of the content was 
on coping skills. The list of objectives was used by the Internal 
evaluators for constructing the criterion Instruments. We are 
concerned that the Instruments were not as relevant to the project as 
they should have been because of their being based on an Inappropriate 
set of behavioral objectives. 
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After the planning work was completed, the staff began work on 
developing the materials. The areas covered by the materials 
are presented In Figure 1. (The numbers are of the number of persons 
who received each unit.) The development task was larger 76 units. 
The Intent was that the units would be put together using materials 
that were available, and the review of available materials was 
exhaustive. The review revealed that about 45 of the units required 
that all or part of the material would need to be written by RFD 
staff. A bigger task than was anticipated, and one which created 
problems. 

A writing staff was employed during the first and second years. 
Some units were produced during the first year and field tested 
with a sample of Head Start parents and ABE students. The reaction 
to the materials In the field test was favorable. Some problems 
were encountered with the work of the writing staff. Some with 
whom we talked felt that they did not receive enough direction and 
wasted some time. This lack of direction probably occurred 
because of the unanticipated magnitude of the task and because the 
work was of a relatively Innovative nature so that the project was 
feeling Its way. 

Most of the units were assembled In time for the demonstration. 
Ten were not done, however. Before discussing the demonstration, 
however, we will present some judgments about the content center materials. 

The project staff indicated that they used three general criteria 
for selecting or developing materials. The criteria were Under- 
standablllty, Bellevablllty, and Usability. We have judged the 
materials on these three criteria and the sub-criteria under each. 
The following table shows our judgments. 



Excellent 



Good 



Fair 



Poor 



A. 



Understandablllty 
Clarity 



Simplicity 
Specificity 
Readability 



X 



X 



B. 



Bellevablllty 
Identity 

Intentlonallty and Honesty 

Objectivity 

Reality 



X 
X 
X 



X 



C. 



Usability 
Practicability 
Applicability 
Transferrablllty 



X 
X 
X 



X 



ERIC 



311 



-22- 
Figure 1 




ill CONTENT CENTER: ABOUT ME AND MY MONEY 

PARTl: ABOUT MY HOME 

WMuh Ai MANAGING MY ^AMILV S MONEY 

88 Ufiitl: My tncomt 

113 Unit 2: family Spamting Plan 

90 Unit 3: UiinQ My Crtdit Wisely 

106 Ufiit 4: Famtty Sfcurlty flan 

Moduta 0: THE JOY OF GOOD FOOD 

710 Unit 1 : A CHoica Cauarola or Sx^ 

664 Unit 2: ' Supptr on tha Tabia on Tkna 

700 Unit 3: Maals for a Day 

696 Unit 4: Wiia Pl^nmn^ ♦ Smart Shoppina « Good Maatt 

Modula C: BUYING GUI0€S 

213 Untt 1: how to Buy Wiiaty 

316 Unit 2: ' Smart food Shoppina 

190 Unit 3: How to Buy Clothing 

202 Unit 4: Suyina Homa Furniihtn|tand Apptiancai 

186 6: SatitfKtion Guarantaad 

Moduta Oi HSALTH. SAFETY AND SANITATION 

349 Unit 1: Emargancy first Aid 

349 Unit 2: Homa f irtt Aid 

349 Unit 3: Homa Safaty Plan 

349 Unit 4: Knowing Signs of lllnaia 

349 Unit S: Homa Sanitation 

Modula E: MAKING A HOUSE A HOME 

94 Unit 1: A Man's Homa is His Castia 

1 17 Unit 2: Taking Cara of th« insida 
170 3: Taking Cara of tha Outtida 

1 18 Unit 4: How to Oe-lt*Yourtatf Rapair s 



PART II: ABOUT MY WORK 



I CONTENT CENTER: ABOUT ME 



Modula A: UNDERSTANDING MYSELF 

100 Unitt- Who Am I Accapting a Viaw of Myiall 

95 Unit 2: Who Am I A Potitiva Viaw of Mytalf 

92 Unit 3: What Af facts Ma Haradity and Envifonmant 

96 Unit 4: What I Batiava ^ISWtraloping Charactar 

Modula B: MY WE LL BE ING 

70 Unit 1: My Physical Health 

72 Unit 2: My Mental Health 

g5 Unit 3: My Education 

gQ Unit 4: My I etsura and Racraetion 

90 Unit S: Maturing and Growing Old Gracefully 

Modula C: BECOMING A BETTER PERSON 

77 Unit f: I AmChengtng How Chenga Affects Ma 

35 Unit 2* t Am a Person Dignity. Integrity 

49 Unit 3. Motivation Self-Direction 

69 Unit 4: I Cen Make Things Change 



93 
93 
93 
93 
93 



38 



Moduta A: 

Unit 1: 
Unit 2: 
Unit 3: 
Unit 4: 
Unit S: 

Modula 
Unit 1: 
Unit 2: 
Unit 3: 
Unit 4: 

Modula C: 

Unit 1: 
Unit 2: 
Unit 3: 
Unit 4: 



HOW TO LOOK POR AJOB 
Sources of Jobs 
Letters end Forms 
Personal Interview 
Importent Job facts 
Summary for Job Hunters 

HOW TO APPLY FOR THAT JOB 
/nc/udad/n Modula A 



HOW TO GET THE MOST f ROM MY JOB 
My Rasponsibttities to the job 
My Boss's Responsibilities to Me 
Gatting Ahead on the Job 
Laws Protecting Workers 



it CONTENT CENTER: ABOUT ME AND OTHERS 





Mod;jie A. 


MY FAMILY 


72 


Unit 1 


Home IS for Femity living 


n? 


Untt 7 


Glutting AlfifHi with One's Marriage Partner 


104 


Unit 3 


Uncirrstamitftg FaiOtngs of Family Members 




Unit 4 


Gutdtng Children end Building Cheraatar 


91 


Unit S: 


Family Good Times 




Module B: 


COMMUNICATING WITH OTHERS 


bo 


Unit V 


My Pfternit 


44 


Untt 2 


My NeighlK>rs 


82 


Unit 3 


The Art of Listening 


66 


Unit 4: 


Resoecttng Other People's Idees end Beliefs 




Module C: 


WORKING WITH OTHER PEOPLE 




Unit 1 


People 1 Oeal with for Sf»rvices 




Unit 2: 


People t Work vwth on the Job 




Unit 3* 


People 1 Work for 
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IV CONTENT CENTER: ME AND MY COMMUNITY 



as 


Module A: 


ME AND THE PEOPLE 


Unit V 


Of The People. By The People. For The Peopia 


37 


Unit 2: 


The OaeUrattOn of Independence 


41 


Unit 3: 


Our Constitution end Whet it Meens 


36 


Unit 4: 


How We Organue to do Business m Ar>^rica 




Module B: 


MY GOVERNMENT. HOW IT WORKS 


168 


Unit 1: 


In My CommfimtV 


60 


Unit 2: 


In My State 


97 


Unit 3: 


In My Country 


68 


Unit 4: 


In the World 




Module C: 


CITIZENSHIP (S TAKING PART IN OECISIONS 


124 


Unit 1: 


My rights es eCiti/en 


122 


Unit ?: 


My Respon^tbtltttet as e Cititen 


66 


Unit 3: 


Qfftng en ln(ormp«l Citi?i>n 


86 


Unit 4: 


Pofniletioni Poliuttoni Conieryat<onl 


141 


Module 0: 


WHERE TO GO. WHO TO SEE . WHAT TO 00 


Unit 1: 


WWf ar# ami Emnioyment Services 


141 


Unit 2: 


Medicel end Health Services 


141 


Unit 3: 


Legal Aid Services 


141 


Unit 4: 


Leisure and Recreetionel Stivices 
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We obviously are impressed with the materials. Furthermore, more 
of our ratings would be In the excellent column If we had judged only 
those materials written by RFD. 

Following are some specific points about the materials 
developed by RFD. 

1. The materials did deal with essential coping skills. 

2. The Ideas were presented In Interesting fashion for ease of 
reading. 

3. There was excellent use of pictures, charts, and araphs. 

4. There were many good and specific suggestions of ^do's and 
don'ts". 

5. The materials were focused on one Important concept at a time. 

6. The approach was appropriately geared to appeal to adults, 
e.g. (a) pictures were of adults - not children, (b) starting 
units with concrete suggestions rather than abstract principles 

7. The pictures were of people of varied age and background. 

8. Pronunciation helps might have been useful, e.g. lasagna. 

9. A few of the suggestions might be Inappropriate, e.g. getting 
Julia Child's Cookbook at the library. 

10. Pamphlet on master mix Instructions was not Included In 
Module B. How was It receiver^? 

11. Are the table setting Illustrations appropriate to the 
experiences of the target audience? 

12. We were especially Impressed with Modules B,C, and D of 
"About My Home". These were among the first modules completed 
which might lead to some Inferences about quality In 
relation to time. 

The following are reactions to the selected materials. 



1. The reading level was generally more difficult and often the 
print was more difficult than the RFD materials. 

2. There was some duplication of content e.g. Module B In 
"About Me" and Module D In "About My Home". 

3. The poor reader would need help with many of the words 
and the math examples. 

4. The selected materials were just not as appropriate as the 
RFD materials. They were a compromise. 



Demonstration 



As Indicated above, all but 10 units were ready when the 
demonstration started. The intent was that the home study materials 
were to be available to anybody upon requesc. The potential 
participant was made aware of the materials In various ways. The 
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main avenues of awareness were the TV program and» for the treatment 
group, the home visitor. Other means were the Almanac, action 
Tine, and personal contact. The participant was sent an order form 
that was very similar In form to the content center listings sheet. 
They were to order those units or modules that they wanted. 

The response was quick and much greater than anticipated. Several 
people ordered everything. These requests were not honored. Rather 
a contact was made with the person to determine a single unit or 
module that was of most Interest, and that was sent. Of course 
this person was encouraged to submit new orders for single Items 
when ready. 

The large response caused problems. First, the supply of 
materials was exhausiled quickly In some of the centers. Consequently, 
there was a lengthy delay In filling some orders. This situation 
was especially unfortunate as it affected the experiment. Some 
of the participants In the experiment experienced the delays. We 
feel the project should have set aside a complete set of content 
centers for each person In the experimental and control groups so that 
the experiment would not have been confounded by differential non- 
availability of materials. 

A second problem stemming from the response was that the home 
study teacher did not function as Intended. Our Interpretation of 
the Intended role of this person was one of diagnosis and reaction. 
She was to work with the home visitor or directly with the 
participant In Identifying educational experiences that might 
be appropriate for the participant. For example, she would Identify 
materials In the support tracks, computation and communication 
skills, that might be useful for the person to study in order to 
benefit maximally from the materials In the content centers. She 
was not able to do this. Her time was taken In simply trying to satisfy 
the volume of requests for materials. 

Our main criticism of the home study component Is that It 
did not operational Ize the conceptual model. Coping skill materials 
did get into the homes, but there is little evidence that much of 
the material in the literacy skills tracks did. This was partly 
due to the problem cited above, but also due, we think, to the 
use of such a "soft-sell" approach to literacy skills as not to 
sell them at all. We think, for example, that a literacy skill 
content center might have been included on the order form. Also 
the home visitors might have had more training than they did on 
identifying educational problems of participants and suggesting 
literacy materials for study when appropriate. 

We are also critical of the lack of clientele analysis of 
who ordered the home study materials. We do know that the treatment 
group ordered significantly more materials than the control group 
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or general population. We also know that a greater proportion of 
the control group ordered materials than the general population and that 
the quantity Is also greater. Needed data are those that describe 
the characteristics of the orderers In the general population. 
Were members of the target audience ordering the materials or 
were the orderers from the middle-class? This Information Is not 
available. Examination of the figures on orderers on the content 
center listings suggests the possibility that the greatest appeal 
was to middle-class women who like to get new recipes and cooking 
hints. 

Since the demonstration, the project has worked on revising 
and completing the content centers. Several of the modules are 
being prepared In the third year for a publisher. The publisher 
will market the materials as part of a new Adult Basic Education 
package. The judgment of the publisher Is another bit of evidence 
of the good quality of the materials. 

This arrangement seems rather unique. We have questioned the 
appropriateness of a funded project preparing materials for a 
commercial publisher. On the other hand, materials are disseminated 
well If there Is a marketing and distribution organization, and 
commercial publishers have such organizations. With an appropriate 
contract, the commercial publishing route Is probably the 
efficient and effective way to get new materials disseminated. 

In summary, the home study materials component was well -conceived. 
There was a tremendous work-load demand In this area, and the demand 
was rather well met. The materials that were developed were of 
high quality and very appropriate for the target audience. The 
component was not able to fulfill Its expectations as well as 
Intended, but the staff did learn many things about content and 
operatlonallzing the concept. Studying the experience of RFD should 
be useful for others contemplating a similar model. 
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Home Visit Component 



In terms of cost-per-unit, the home visitor component was the 
most expensive aspect of Project RFO. Appropriately, It Mas also the 
component that was studied most Intensively In the evaluation. 

Specification of the home visit component In terms of numbers 
and function was vague In the first proposal. This came Into focus 
during the planning year. It soon became apparent that there were 
rather strict constraints on the number of home visits. A decision was 
made to restrict the number of participants who would receive home 
visits to a manageable size. The evaluation personnel were consulted, 
and considering time, money, and data needs, a figure of 50 was 
determined. The evaluation design was then developed to permit a 
sample of 50 to be drawn from a larger population. These would 
receive the home visits. Another sample of 50 was drawn from the 
population and assigned to a control group of persons who had 
access to all of Project RFD, but the home visits. 

Decisions about the function of the home visitor were also 
made during the first year and early part of the second year. 
The Idea that the home visitor be an Instructor was rejected on 
the basis of the problem of recruiting persons with appropriate 
training and background to the position. It was felt that the 
home visitor must be able to relate readily to the participant. 
Only after rapport was established could progress be made In the 
educative area. Accordingly the primary functions of the home 
visitor were deemed to be as adviser, confidante, and friend. This 
decision was studied Intensively by the staff, and we feel the decision 
was justified. 

The home visitors were selected and trained during the first 
part of the second year. The selection criteria were quite vague. 
The home visitors were expected to be from an environment where 
they would have experienced Intimate contact with people like those 
In the target audience. They were also expected to be articulate, toler- 
ant, and people-oriented. Those hired seemed to meet the criteria. 
It Is important to note that all persisted through the project. Eight 
home visitors were selected and each had a load of 6 or 7 participants. 
The home visitors were employed on a half-tlmo basis. 

Three supervisors of home visitors were also employed. The 
supervisors were essentially resource people for the home visitors. 
They served as facilitators as well as trainers and helpers. The 
supervisors aUo administered tests and conducted the follow-up 
Interviews. They were employed full-time. 

There Is no clear evidence of the numerical adequacy of the home 
visit staff. Intuitively we have a feeling that one supervisor per five 
to ten home visitors would be sufficient and that one half-time home 
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vlsltor could work effectively with 10 participants on a weekly 
basis. Some of the home visitors expressed a feeling to us that they 
could have worked with more people. 

The training of the home visitors was very much based on partici- 
pation and problem solving. A three day session was held In which 
the role was discussed and potential problems Identified. Study 
materials were available for the problems and discussions were held. 
After this session, the home visitors were sent Into the communities 
to learn about the community and Its resources and to Identify 
potential participants. The home visitor was to visit with people In 
power. In agencies, and with potential participants. This experience 
was expected to provide the home visitor with skills In relating to 
various people and with knowledge of the resources. In the process, 
the home visitors Identified a population of 300 people In the four 
counties. This population was the group from which the two samples 
of 50 were drawn. 

The home visitors and supervisors met regularly during this time 
and also during the demonstration to discuss their work. These sessions 
also provided training. 

The home visitors were rather critical of the training. They 
expressed a feeling that they were not comfortable with their role or 
their knowledge of RFD. They did not feel ready for their work 
in the community. Perhaps part of the problem Is that the home 
visitors may have had an expectation that they would be In a teaching 
role. After all, this was an education project. It Is also likely 
that the role definition was ambiguous because the project was 
working with a relatively new concept and could not provide a 
clear definition. Although there was discomfort, the home visitors 
did function In the demonstration seemingly as Intended and all 
persisted. Furthermore, two were hired In one county by a vocational 
school to function pretty much as they did In the demonstration. 

In the demonstration, the home visitors were assigned to 6 or 7 
participants. They were expected to visit with them on a weekly 
basis. Some were not able to get with the participant this often, 
however. They were to function as a friend and provide support, 
advice, help, and encouragement as needed. As might have been 
expected. It took some time before the home visitor was accepted In 
this role. In some cases nearly all 20 weeks. Consequently, the 
home visit was not we il -Integrated with the other components. We 
feel the project was cver-optijHntIc about the Immediate effect 
of the home visitor. Either the participants should have been 
selected on the basis of readiness for an educational experience, 
or the home visitors should have had some lead time to establish 
rapport before the other components were Introduced. We believe that 
this factor was very Important In the project's not having a 
demonstrated effect. 
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The training of the home visitors might also be criticized 
In Its de-emphasis on the Instructional role. The home visitor might 
have been better prepared to make decisions and suggestions about what 
materials the participant could study with benefit. Also, the 
visitor might have been trained In helping the participant use the 
materials not only for the Information but also as a means of Improving 
literacy skills. We Imagine that the need for this kind of training 
would have become more evident If the demonstration had extended over 
a longer period of time than It did. 

The home visitors were sometimes In an uncomfortable position 
of being apologlzers for the project. They often encountered 
situations where a promised TV repair did not occur, ordered 
materials were not received, or other promised action did not 
materialize. Furthermore, the visitors learned to distrust the 
project somewhat. For example, they thought they were hired 
for 10 months but were terminated after 9 months, and the travel 
expense provision was changed during the project. In general, 
we doubt that the home visitors Identified very closely with the 
project. It almost seems that they became adversaries In some respects, 
which. If so, likely had adverse effects on the project. 

The problems that were encountered with the home visit component 
were understandable. We have little knowledge base for such 
activities, and the experience of RFD has contributed to the knowledge 
base. Despite the problems, the home visitors did function effectively. 
They were able to work with the participants and build a meaningful 
supportive relationship. They were also effective In that the 
participants with whom they worked were Involved In many kinds of 
educational activities that they likely would not have had without 
the home visits and the rest of RFO. 
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Other Components 
(Action L1ne» Almanac, Radio) 



These three components were not part of the original conceptuali- 
zation, and only the Action Line component was described In the 
second year report. A brief discussion of each component Is presented 
below. 

Radio 

Very little Information Is available on the radio programs. 
Apparently these were developed as short spots (3 to 5 minutes) and 
were to serve a motivational purpose. Relatively little money or 
time was devoted to this component. 

There Is little basis for judaing the adequacy of this work. 
Radio does have some unique possibilities that have already been 
demonstrated In things like correspondence study. We would suggest 
that the use of radio In the model be expanded and studied. It 
may well be that radio could be used effectively for motivational 
purposes at a much lower cost than TV. 

Almanac 

The RFO Almanac was a four page newspaper. Six Issues were 
printed and distributed to the participants at regular Intervals 
during the demonstration. Its content was closely tied to the 
TV programs. Tips, recipes, descriptions and "advertisements" 
about RFD materials wer« Included. Its format was quite attractive, 
and It was very readable. The vocabulary level, however, seemed 
to be somewhat higher than one would expect from the target audience. 

The rationale for the almanac has not been recorded. From 
our interviews with the staff and our examination of the paper, 
we have decided that the almanac was used as a way of maintaining 
a contact between the project and the participant. It seemed to 
be designed to stimulate Interest In RFD and to provide Information. 
Reactions to the almanac were quite favorable. 

The RFD Almanac was a very interesting idea. It was relatively 
Inexpensive, and our impressions from reading It were that it 
probably served useful purposes as a stimulator, in maintaining 
Interest, and in providing Information. The contribution of something 
like an almanac to the success of a home-based model merits further study. 

Action Line 



The action line component was designed to provide the learner 
audience with a direct communicative link with RFD. Before action 
line was conceived, the links were via the mails or, for a few, the 
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homt visitor. The personallztd naturt of tho teUphono comminl cation 
along with the promise of Immediate action gave action line a 
unique and Important contribution In the project. 

We were Impressed with the careful planning that was used In 
developing and Implementing action line. Anybody considering such 
an activity would benefit from reading the description of this 
component In the second-year report of the project. 

Action Line was used. There were some 1600 calls over the 
line In the five months. Furthermore, the satisfaction of the callers 
with the action or Information received was high. 

Action Line was relatively Inexpensive because It was staffed 
by 50 volunteers from a church organization. The use of volunteers for 
such an activity Is a good approach. We do feel some concern about 
the general liability of this procedure, to other communities) and 
with the question of how long the activity could be maintained 
with volunteer help. 

In our judgment the Action Line component made a definite and 
unique contribution to the project. It Is a technique or medium that 
would appear to have many possibilities In delivering Information 
and stimulating participation. 
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Design and Evaluation 



The RFD Project was fortunate to have the Psychometric Labor- 
atory of the University of Wisconsin School of Education, Involved 
with the Internal evaluation. The Psychometric Laboratory made 
available a number of qualified Individuals for assistance In the 
Internal evaluation of RFO. 

The Internal evaluation had three distinct aspects: a) the TV 
component, b) the TV and the content material component, and c) the 
home visit component. Each aspect was evaluated In different 
ways and. In order to reduce complexity, this report will consider 
each evaluation aspect separately. 

The TV Component 

Evaluation of the TV component dealt Initially with the problem 
of trying to obtain information about the Impact of specific TV 
tapes on the target population. The original plan was to submit 
new tapes to groups similar to the target population and ask for 
a detailed critique. Those participating were to be subdivided Into 
a viewing group and a control or non-viewing group and an achievement 
test was to have been given to both groups at the termination of 
the viewing for the experimental group. Failure to find sufficient 
participants forced a modification of this procedure. Ultimately, 
all participants viewed the TV tapes and were asked to Indicate 
what they liked or did not like and what was helpful and appro- 
priate. Since the TV tapes were still In production, future 
tapes could reflect consensus views arising from such discussions. 
Generally, the evaluation of the tapes was reported as favorable and 
the procedure was no doubt rich In suggestions for writers and producers. 
One wishes, however, that the original plan could have been inaugurated 
since It might have afforded an early Indication of the difficulty 
of materially affecting the achievement of ABE Individuals unless the 
educational experience. In addition to being captivating, hds 
focus and direction. 

A second concern with respect to the TV component centered around 
the actual population viewing the RFD programs — Who were they and 
approximately how many were there? Various telephone procedures, some 
of them quite extensive in nature, were employed during this evaluation. 
There is data that the viewing audience for the RFD audience was 
high — possibly as high as 24 percent for rural viewers and 28 
percent for urban viewers. It Is also apparent that the programs 
attracted a much higher percentage of women {60%} than men(20%) and this 
is reflected throughout the RFD program in numerous ways. For example, 
all of the home study visitors were women. 
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Tht TV and the Content Material Component 

Again, the ABE- type participants were asked to respond to 
various of the content materials as they were prepared. These 
surveys were limited In nature and Involved no comparison materials. 
It does» however, seem reasonable to conclude, on the basis 
of what was reported, that the content materials were generally 
judged to be relevant, readable and clear by subjects sharing many 
of the concerns and experiences of the target population. 



The Home Visit Component 

Since one of the most costly features of the RFD program 
relates to the home visit component, it is appropriate that most 
of the formal Internal evaluation was directed to this component. The 
Psychometric Laboratory proposed a two-group design involving 100 
subjects as a test of the effectiveness of the home visit component. 
In an early position paper it was forcefully argued against the 
adoption of a pre- and posttest format. Instead, it was decided 
to select 100 subjects all of whom met certain adult basic 
education criteria and then randomly to assign 50 subjects each to 
an experimental and a control group. The experimental subjects 
were to receive the home visitor while the control subjects 
were not. Obviously, control subjects had access to all other RFD 
components — TV programs, content materials, hot line, etc. 
Ultimately, 71 females and 29 males were randomly (except for 
some geographic constraints) assigned to the experimental and control 
groups. Although it was not apparently Intended to be this way, 
through some Inadvertence the randomization actually resulted In a 
"separation" of some six family members into the two diverse groups. 
This seems to have been a poor procedure in that It affords the 
possibility for results which are not measurable. If one has 
expressed a desire to have the home visitor and only his wife (or 
husband) receives one, what will be his long-term response? Will 
he despair and become indifferent? Will he work harder on the 
content materials which come into the home? Will the selected 
subject "protect" the one not selected by less than a maximum 
effort? There seems to be no way for assessing such outcomes. 

At the end of 20 weeks there was an extensive evaluation 
involving a comprehensive test which was prepared by the University 
of Wisconsin Psychometric Laboratory. Before this battery is 
considered, it is important to indicate the presence of another 
unfortunate problem in the administration of this test. It relates 
to an initial promise to the participants that no formal evaluation 
would be given. Many subjects were apparently upset by this sudden 
request which actually came sometime after the home visits had 
terminated. In addition, the home visitors, who were called out to 
administer the test, were most unhappy about their particular role 
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In this and this unhapplness was Intensified In that their tenure 

with RFD had terminated one month before they had expected that 

It would. One cannot, of course, assert that these factors Influenced 

the test results. Indeed, It seems unlikely that any Influence 

of this sort would have exerted a systenwitlc effect. And yet. It was 

not the most advantageous circumstance In which to evaluate the home 

study component. 

Each of the available subjects (46 experimental and 46 
controls) were given a battery of six tests which was prepared by the 
Psychometric Laboratory. Three of the measures were: 1) comnunl cation 
skills, 2) computational skills, and 3) coping skills. All three 
tests were Ingenious, readable, and Interesting but they did demand 
one hour and thirty minutes for completion. Although there was 
no formal validation procedure for these tests they had high 
reliability and there Is no reason, particularly In view of the 
competence of the people of the Psychometric Laboratory, to question 
the quality of the Instruments. Three additional subtests dealt 
with: 1) the locus of perceived "control" (Internal versus external) 
that a subject experienced, 2) an attitude measure toward education, 
and 3) a "behaviors" test entitled, "The World About Me". All three 
of these latter scales required an additional thirty minutes to complete. 

The results of these six tests Indicate no significant 
differences between the experimental and control groups. In fact. 
If one Invoked a one^talled comparison (which seems appropriate In 
that a priori predictions were Implicit In the entire test procedure), 
there'"1s only one test, "The World About Me", which approaches 
(.08) the arbitrary .05 level. Even In the most promising result the 
mean difference between groups was only 2.45 (41.54 against 39.09) 
and one can only question what such a difference means In practical 
terms, quite apart from any statistical considerations. 

A follow-up Interview was conducted with members of the 
experimental and control group some six months after the demon- 
stration. The purpose of the Interview was to determine If there 
were long-term effects of the project. The Interviews were conducted 
by the home- visitor supervisors. No differences were observed 
between the groups on the questions. These Interviews were resisted 
by several participants. They did not expect them, and they were 
suspicious of the purpose. This project certainly demonstrated 
the Importance of the problem of sensitivity of the undereducated 
adult to data-gathering procedures. 

The objective results of the home study component are most 
discouraging. On the other hand. It Is important to consider that 
the time frame of the program was unusually short. This Is particularly 
the case If one considers the initial problems the home visitors 
had In gaining the confidence of the experimental subjects. They 
began their contacts as friends and only gradually did they shift 
the nature of the visits to work sessions Involving various 



3Z3 



-34- 

content iMterlals. in many casts thtre simply wasn't tnouoh tima 
to got the study program going effectively. The external evaluation 
team was able to observe considerable progress with some subjects 
In one county where two home study visitors were retained by the 
County and continued to work with some of their subjects long after RFO 
was terminated. It Is quite possible that a twenty week period 
Is necessary just to ensure that the home study visitor can be 
effective In a more explicit educational program. 

It should also be pointed out that the skills tested In the 
Wisconsin Test of Adult Basic Education (WITABE) were general In nature. 
Even had the home study component been more focused on adult 
basic education. It Is difficult to see how life-long patterns 
of dealing with reality could have been materially altered In so 
short a period. Another way of discussing the WITABE Is to say that 
It was most certainly an Instrument which afforded little oppor- 
tunity for manipulation by direct "coaching" of participants. All 
of this reflects credit to the RFD staff and to the Internal 
evaluation team who Insisted that their program be given an honest 
appraisal. 

One of the project's consultants. Professor Robert D. Boyd, 
made an Important point In the RFD Newsletter (August 1971) when 
he said that RFD might not significantly affect basic reading ability 
or other narrow educational objectives but might still prove to 
be a powerful program If It resulted In differences In self-esteem 
and community Involvement. Unfortunately, the objective evidence 
does not support a contention that such changes took place. But 
once again the brevity of the program has to be a consideration. 
There Is evidence secured by the external evaluation team that 
experimental participants requested, on their own Initiative, 
significantly more content materials than did control subjects or 
a group of subjects who were randomly selected from those who 
had made at least one request. This seems to be the kind of behavior 
Professor Boyd had In mind and this particular result should not 
be dismissed as trivial. It is unfortunate that some unobtrusive 
measures of actual behavior could not have been secured on experimental 
and control subjects — such things as their frequency of use 
of the Public Library, their understanding and use of community 
agencies, etc. The procedures used In selecting experimental and 
control subjects could In Itself have served to sensitize control 
subjects with respect to educational attitudes and have militated 
against differences in some of the measures. At this point It 
would have been advantageous, although admittedly costly and diffi- 
cult, to have secured test results from a second control group 
consisting of subjects meeting the adult basic education criteria 
and requesting at least some RFD materials. 

One other point should be made from the finding regarding 
participation. The results reinforce research that indicates that an 
overt commitment to doing something Is related to participation and 
persistence. 
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One final evaluation of the home visit component was an extensive 
"debriefing" of the home visitors by the staff of the Psychometric 
laboratory. This report, which parallels many of the things the 
external evaluation team encountered In their talks with available 
home visitors, points to perceived Inadequacies In the Initial 
training of the home visitors. There were other complaints which 
grew out of the role ambiguity home visitors felt as "teachers" 
but, more basically, as friends of the participants. Problems or 
difficulties of the home visitors resulted from faulty communication 
(e.g., the previously discussed mixup with respect to whether or 
not subjects would ultimately be evaluated) and a failure of the RFD 
staff to act promptly on some of their Initial commitments. 

The following are offered as specific points of critique of 
the design and Its execution. 

1. The design was appropriate for determining the effects of 
the home-visit component. A problem with the design, 
however. Is that It provides little opportunity to assess 
the effects of the TV and content materials. Some sort 
of Indicator of change would have been useful. 

2. The evaluation work was kept separated from the operation to 
maintain objectivity. A problem with this procedure, 
however. Is that the evaluators were not cognizant of some 
of the changes of emphasis, e.g. reduced emphasis on literacy 
skills. 

3. Many data were gathered and analyzed. It would have been 
desirable If there had been more data on characteristics 
of those who ordered content materials and the users of 
action line. 

4. The operation of the demonstration was faulty In that some 
homes did not have working TV sets, some participants were In 
a marginal viewing location for the station, and the content 
center materials were either not done or in Inadequate 
supply so that the participants failed to get what was 
ordered or experienced a long delay. 

It Is easier to criticize than create. Generally we were favorably 
Impressed with the design and execution of the demonstration and evalu- 
ation. We do feel It Important, however, to point out some of the 
possible reasons for the lack of Impressive results. 
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Project RFD was very effective In Its publicity and dissemin- 
ation activities. * We have heard comments like "RFD sure tells 
Its story", "They really tell what they are doing", etc. from people 
all over the nation. The fact that the project director had a 
background In publicity work was a factor In determining the amount 
and kind of publicity and dissemination used. We were Impressed with 
this work. The quality was good and the techniques were quite sophis- 
ticated. Educational developers would benefit from studying and using 
the dissemination techniques of RFD. 

Of course there was some criticism of the dissemination activities. 
Some said that the project "tooted Its own horn" and "I get tired 
of hearing about RFD". Some of these comments were probably justified, 
in other cases there seemed to be an element of professional jealousy 
in the remarks. Certainly there is a line where publicity has 
overkill possibility. Most educational activities are nowhere near 
this line. Our impression is that RFD did publicize itself more 
than most educational programs. The publicity was in good taste 
and honest, and we feel the educational community would benefit if 
most projects told their story as well as RFD has. The following 
material discusses the internal and external dissemination efforts 
separately. 

Internal 

Several techniques were used to publicize the project to the 
potential participant as well as other persons in the area who might 
be Interested or affected. Among the techniques were the following: 

1. Several meetings were held with agency people in the 
counties. I.e. welfare, extension, adult education, etc., 
to explain the purposes and procedures of the project. 
These meetings helped to forestall conflict when the demon- 
stration was done, and also enlisted cooperation from the 
agencies. * 

2. Booths for the RFD Project were set-up at county fairs. These 
booths made persons aware of the project, and also solicited 

a large number of names of people as potential participants. 

3. Shortly before the demonstration was started, the project took 
advertisements 1n papers, radio, and TV. It seemed this 
advertising paid-off in that there was a relatively large 
immediate audience for the TV programs and a large volume 

of requests for materials. 

4. The almanac, critiqued elsewhere In this report, was also 

used to disseminate information about the project to participants. 
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5. Members of the project staff spoke to several groups » like 
service clubs, about the purposes and procedures of the project. 

6. Surveys were made of adult Interests and TV viewing habits, 
and meetings were arranged for feedback about the TV tapes and 
the materials. Dissemination was an Important by-product of 
these activities. 

The RFD Project regarded their program as a product to be 
marketed, and they did an effective job of marketing. The effective- 
ness Is demonstrated by a high participation rate by the adults In the 
four county area. 



External 

The project also did many things to disseminate Information 
about the project to audiences around the country. Among these 
were the following: 

1. A newsletter was published monthly and distributed widely. 
The newsletter was attractive, well -edited, and Informative. 
It was also honest In that It Informed people about what had 
happened and of the problems. 

2. The project staff made presentations at professional meetings 
and served as consultants to various projects. Some of the 
staff are now consulting with the Adult Learning Program 
Series (ALPS) project. The Impact of these activities Is 
demonstrated by many letters In the files from persons all over 
the nation In wnlch high Interest Is expressed In RFD. The 
experience and knowledge of the staff of RFD are also permitting 
the contribution of many Ideas to the ALPS project. 

3. The project staff solicited for expansion of the project to 
the Central States region. The Intent was to develop a network 
In the several states and provide RFD to the undereducated 
adults In a large region. The proposal was not supported by 
the ABE personnel In those states. Thus, this effort at 
dissemination failed. 

The project staff also attempted to interest the university 
and various state agencies In Wisconsin In carrying on 
with the work. Some Interest was expressed, but nobody did 
make a commitment. The stated reason was that budget cutbacks 
prevented the university or the state agencies from adding 
an activity. 

These are important events that have to be regarded as negative 
outcomes. The budget cuts were a factor, but it is also 
possible that the people were not convinced that RFD had 
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demonstrated a sufficient level of effectiveness to justify 
Its becoming operational on a broad base. We tend to feel 
the decisions were justified. However, this statement 
should not be Interpreted that we feel RFD Is a failure. 
Rather we feel that the model has promise, but that It 
can be Improved and should be before It Is considered ready 
In an operational sense. 

4. The third year of the project Is essentially a dissemination 
year. Project staff members are still presenting to professional 
groups and consulting. There are two other kinds of 
dissemination activities this year. First, the project 
has arranged for and Is making formal presentations about 
the project In the ten USOE regions. Interested people from 
the region are Invited to attend these two-day meetings and 
receive the story of RFD. About 300 persons attended 
these meetings. We attended one of tne meetings. The presenta- 
tion was Interesting and honest. 

There Is one concern we have about these meetings and the 
third-year work generally. Evaluative Information should 
be available for the dissemination presentations. Unfortunately 
much of the evaluative Information was not available until 
the middle of the third year and some were only available by 
the tenth month. We would criticize the project In Its not 
pushing harder to get the evaluative Information and analyses 
done quickly so that these kinds of Information would have 
been available for most of the dissemination year. 

The second activity of the third year is to revise old and also 
write new content materials for publication. A publishing house 
has contracted to publish and market much of the content material 
of RFD. This should lead to widespread dissemination of these 
materials. 

The third year of the project Is viewed with mixed emotions by the 
evaluation team. Essentially there are three activities: dissemination 
to regions and other meetings, proposal writing, and the preparation of 
materials for publication. We find It somewhat difficult to justify 
the level of funding that the project had for this year. On the other hand, 
we predict that this project will be well -disseminated in terms of Infor- 
mation and products. It will not be lost as a dust-covered report on a 
shelf. Perhaps the kind of activity that was permitted In the third year 
Is Important for obtaining maximum benefit from a project. People will 
be stimulated by the Ideas, they will benefit from the availability of the 
materials, and the field will benefit from the fact that the staff has 
had time to reflect and develop ideas for further study of the model. We 
raise the issue without being able to make the judgment. 
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Aditilnl strati on of Project RFD 



Project RFD was administered In the Communications Department of 
the University of Wisconsin-Extension. The project was directly 
accountable to the General Manager of WHA-TV, the University 
television station. Several people on the University staff were 
Interviewed. Generally, these people were quite familiar with the 
project and Interested In Its results. The general feeling seemed 
to be that the RFD model might be very useful for extension activities 
of the University. There was very little criticism of the project. 
One point of criticism, however, was that the project was Identified 
as a TV project by Its being administered under the TV station. 
There was some feeling expressed that the project should have had 
a closer relationship with the educational programs In the University. 
We see some justification to this criticism, if for no other reason 
than public relations. The image of the project for many was as 
a TV program producer rather than an education project. Should RFD 
continue in some form, it may be well to consider having It admin- 
istered In a department like continuing education and contracting for 
services with the TV station. Our general Impression of the adminis- 
tration of the project In the University Is that It was able to 
operate well In and received reasonable support from the University. 

The Internal administration of the project was also sound. The 
project director seemed to be running things, but at the same time 
delegated responsibility In a real sense to the two associate directors. 
An associate director left after the first year which probably affected 
the continuity of the project. A replacement was hired Immediately, 
however. The general turn-over of project staff was quite low 
especially for a project on "soft money". 

The fiscal aspects of the project were well -control led. Apparently 
the budgets were accurately determined so that the budgeted and 
actual expenditures were very consistent. 

In our judgment the project's internal administration was good. 
The following points of criticism are offered as things which, in 
hindsight, might have improved the project in an administrative sense. 

1. As indicated above, the image of the project might have been 
improved for some if there had been a co-director in adult 
education or if the project had been administered in an education 
department. 

2. There was some criticism that the advisory council was 
treated in somewhat of a cavalier manner. At times the 
advisory council seemed to be a sounding board rather than 
a group who gave input into decisions. We would also offer 
the critique that the project should have solicited more 
Involvement from the target audience. 
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It must be recognized, however, that at some point decisions 
must be made. The staff did make and accept responsibility 
for the decisions. 

3. There seemed to be some lack of coordination among the 
various components. This is reflected by the lack of 
integration among the components. Also the fact that the 
demonstration experienced procedural problems, such as 
no TV in some homes and shortages or lack of home study 
materials, suggests some coordination difficulties. Some 
of the staff of the project indicated that they were not 
always sure of what they were doing. Some of this feeling is 
understandable in that the project was in a sense feeling 
its way. On the other hand, there is some evidence of a 
lack of coordination among the project administrative staff. 

These points of criticism are possible problems that we perceived 
in the project administration. In the main, however, we feel the 
project was well administered. 



3j0 



Cost Analyses 



Decision making and resource allocation In the private sector 
of the economy Is guided, at least In a general sense, through 
market-established prices. By studying the conditions under which 
market prices are established, economists have been able to draw some 
tentative {and often very restrictive) conclusions about the efficient 
allocation of resources In the private sector. On the basis of 
that Information, public policy Is formulated for the purpose of 
achieving economic goals, one of which Is economic efficiency. 

The contribution of economics to the study of choice problems 
Is a derivation from the central "scarcity" premise of economic 
problems. There are some (chiefly the radicals) who argue today 
that affluence— not scarcity— Is not the central economic problem. 
Such persons are fond of eloquently written passages such as the 
following description of a "new order" penned by John Maynard 
Keynes some four decades ago. 

We shall honour those who can teach us how to pluck the 
hour and the day virtously and well, the delightful people 
the lilies of the field who toll not neither do they spln.l 

There Is much about this type of world that appeals to all of 
mankind, for who among us can condemn motherhood, the flag, and 
apple pie? Sadly enough, however, such a philosophy Is a tenet of 
religious faith rather than a useful appraisal and contention about 
the real world today. A fuller reading of Lord Keynes reveals that 
even he recognized this harsh reality In the following admonition: 

But Beware! The time for all this Is not yet. For at 
least another hundred years we must pretend to ourselves 
and to everyone that fair Is foul and foul Is fair; for 
foul Is useful and fair Is not.' 

Like It or not economic scarcity and the efficiency diety are. Indeed, 
our gods for a little longer still I 

Increasing participation by all levels of government In the 
economic affairs of society raises difficult Issues. While economists 
have developed an Intricate theory of resource allocation for the 
private sector of the market econoiny very little progress has been 
made In Improving our understanding of the process of allocating 
resources In the public sector where the price system plays a 
muted role at best. Roland N. McKean, Professor of Economics at the 
University of Virginia, develops the thesis that an "unseen hand" driven 
by power and bargaining guides resource allocation In the public sector. 
The author's cogent plea for greater attention to problems of choice 
and resource allocation are as applicable to the rapidly growing adult 
education Industry as to other categories of government. 



Ij.M. Keynes, Essays In Persuasion (New York: Harcourt, Brace 
and Janovlch, 1932), pp. 360, 362. 

^Ibid. 
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All of this Is not to suggest that cost effectiveness analysis 
of behavior related human resources research such as project RFD 
Is a simple task which answers all questions conclusively. Lest the 
reader forget, the following limitations must be kept uppermost In 
mind: 

1. Economic analysis and the efficiency diety may mask many 
of the nonmonetary considerations which motivate private 
behavior as well as social goals prompting Investment In 
education. Treating people as "capital" to be produced may 
distort a useful and purposeful dimension of life, and In 
any event does not necessarily represent the multiple 
objectives which characterize educational Investments. 

2. Investment In education and particularly In adults Is 
only one of many Interdependent ends which Increase 
economic welfare. Multl col linearity between Independent 
variables such as motivation, customs, socio-economic 
status, and ability, precludes accurate Identification of the 
precise contribution of education much less the marginal 
returns generated by education. 

3. Selection of a "proper" discount rate or the "relevant" 
rate of return Is amb1guous--a problem particularly 
acute where the social rate of discount Is needed. 

4. Quantification of social. Indirect, and noneconomic values 
Is almost Impossible. Educational quality, poverty and 
slums. Income redistribution, or an alteration In national de- 
fense posture due to greater emphasis on education. 

5. Uncertainty prevails In terms of future benefits, costs. 
Interest rates, and time periods In both the private and 
social context. The relative attractiveness of learning 

may change over time as technological conditions are altered. 
Disadvantaged Americans may Invest less In education because 
of a higher time preference for money due In part to different 
perceptions of risk and uncertainty. 

6. Unlike Investments In physical capital, human capital 
expenditures represent consumption as well as Investment 
outlays, again In an unknown magnitude. 

7. Different forms of human capital Investment provide for 
more or less mobility and liquidity. The depreciation 
characteristics of human resources also may be Important to 
investment in education, yet these relations are seldom 
dealt with. 
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The following pages contain various economic analyses of 
Project RFD. The reader should keep the abov^ limitations In mind 
Mhlle considering the results. 

The first part presents an analysis of the budget, and some 
cost/benefit considerations are presented In the last part of this 
section. 



Aggregate Budget Analysis 

Project expenditures over the three-year contract period 
totaled $707,793. Of this amount $653,393 was directly charged to 
the RFD project and Its operations, the remainder representing 
Indirect University overhead charges.^ 

All budget data were compiled and cross classified by 

a) year; 

b) project media component (television, home visit actlvltes, 
materials (largely printed), and "other"— primarily 
general project supervision; 

(c) class of service expenditure (e.g., personnel, travel, 
communication costs, supplies, equipment, rental and 
fees, and evaluation charges); 

(d) type of costs, where type (I) denotes basic R and D outlays 
associated with creation and conceptuaTTzatlon"^ Bie RFD 
format and delivery system; type (II) denotes all costs 
attributable to the development of materials and programs; 
and type (III) represents expenses incurred In the operation 
and actual delivery of all RFD components. Table I and 
Figure I summarize these expenditures by relevant category. 

In terms of budget allocations by media , expenses associated with 
the development of materials and for the television operation accounted 
for over two-thirds of direct RFD expenditures ($256,000 and $172,000 
respectively).^ Approximately two-thirds of all costs for these 
two media are attributable to personnel ($179,000 for materials and 
$79,000 for television). Supplies ($39,000 for materials and $40,000 
for television) and rental and fees ($25,000 for materials and $37,000 
for television) account for much of the remaining expenditures. In 
examing budget outlays by class of service , personnel costs loom 
very large, amounting to $?TT;;i)iOirof the total direct costs of $653,000, 
while expenditures for supplies and rentals and fees represent a 
much smaller but still significant portion of the total amount of 
funds available. The data in Table 2 depict expenditures and percentage 
breakdowns, again excluding the general overhead rate of 8 percent 
of charges at the University of Wisconsin. 



^General overhead charges by the University of Wisconsin totaled 

$54,000. All such overhead charges were "allocated" to class of service, 

type of media, and type of expenditure in proportion to the percentage 
of the total budget allocable to each activity. 

^ ^An data exclude University overhead and are rounded in this summary. 
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Table I 
Budget Data 

Television Home Visuals Materials 



Other Sub Total Overhead 



Personnel 












1. 


$ 23,324 


$ 12,057 


$ 37.647 


$ 11.739»$ 84.767 


2. 


55,258 


37,661 


140.991 


51 ,320« 


285,230 


3. 


458 


43.089 


791 




'Vt , ooo 




79,040 


92,807 


179.429 




414 •f'^il 


Travel 






1. 


15 


502 


274 


2.035s 


2.826 


2. 


3,156 


972 


1 .999 


8,704« 


14,831 


3. 


-0- 


4,913 


683' 


-0- « 


5 596 




3,171 


6,387 


2^.956 


10 739 

Ivy/ ^7 




Communications 






1. 


-0- 


-0- 


.'0- 


606» 


606 


2. 


333 


-0- 


333 


5,450« 


6,116 


3. 


2,893 


1.154 












1,154 


333 






Supplies 








1. 


3,071 


27 


285 


127= 


3.510 


2. 


35,138 


1,002 


8.833 


22,758= 


67,731 


3. 


1,747 


566 


29,882 


•u- - 






3d,d36 


1,595 


39,000 


09 QOC 


1 Uw f H JO T o 


Equipment 






1. 




-0- 


-0- 






2. 


981 


-0- 


-0- 


7 Anfi«- 
/ »0Uo- 


Q COO 


3. 


-0- 


-0- 


-0- 




-0- 




d81 


-0- 


-0- 


7,817 


8,798 + 


Rent, Fees, Etc. 








1 . 


-0- 


-0- 


-0- 


-0- = 


-0- 


2. 


1 1 ,864 


275 


222 


2,752= 


15,113 








OA OOO 


-0- = 


50.162 




37;088 


275 


25;i60 


2,752 


65.275 + 5 


Evaluation 






1. 


1,290 


1,290 


1,290 


-0- = 


3.870 


2. 


7,204 


7,204 


7,285 


-0- = 


21.693 


3. 


520 


924 


520 


-0- = 


1.964 






9,418 


9,095 


-0- 


27.527 + 2 


SUB TOTAL * 


172,476 


111,636 


255,973 


113,308 


653.393 +54 


University 








Overhead 


14.362 


9.302 


21.325 


9.411 


54.400 



898» 11.667 



734= 9.532 



GRAND TOTAL $ 186.838 $ 120.938 $ 277.298 $ 122.719 $707,793 



Category 1 is Cost and expenses associated with basic research and creation activities 
in the conceptualization of RFD <ielivery systems. 

Category 2 i s Cost and expenses (post conceptualization) of the development of 
materials and programs up to delivery phase. 

Category 3 is Cost and expense incurred in the operation and actual delivery of 
RFD systems. 
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$200,000- 



Univeriity, 
"Ovtrhead 



TV 



Home Mafarials Othtr 
Visits 



S400,000H 



200.000- 



$400,000- 



200.000- 



Personnst Supplies Renfol All 

a Fees Other 



R 8 D Development Deiivtry 
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Table 2 



Summary of Various Cost Categories for RFD Project 



Project Media 



Class of Service 






Television 

Home Visits 

Materials 

Other 

Personnel 

Travel 

Communication 

Supplies 

Equipment 

Rent/Fees 

Evaluation 

I: R & 0 

II: Development 
III: Delivery 



$172.5 26.4% 

111.6 17.1 

256.0 39.2 

in.3 17.3 



$414.3 
23.3 
10.8 
103.4 
8.8 
65.3 
27.5 



63. 5X 
3.5 
1.6 

15.9 
1.3 
9.9 
4.3 



$ 95.8 
419.8 
138.3 



14.59; 

64.3 

21.2 



$653.4 



100.0% 



$653.4 



100.0% 



$653.4 



100.0% 



SOURCE: Table 1 



Table 2 also Includes data on the proportion of costs (exclusive 
of overhead) due to basic R&D (type l), development (type 2) and 
delivery (type 3) activities. Among the potential uses for such 
Information Is that It can be useful In approximating the minimum 
scale of an operation at which a project breaks even In the sense 
that returns equal costs. That Is, one can Identify the minimum 
return and the project size best suited to an effort such as that 
undertaken by RFD. 

Tables 3, 4, and 5 break down and summarize the budget for RFD 
by media and class of service expenditure. Not Included In this 
comparison Is a breakdown of the category "other" for It largely 
represents general project management costs and not a form of media. 
As noted earlier, personnel costs are a major share of total costs, 
particularly for the Home Visit program, while supplies and rentals 
and fees are also large for the television and materials media used. 
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Tablt 3 

Television Budget 

Personnel $79.04* 45.8X 

Travel 3.17 1.8 

Communication 3.23 1.9 

Supplies 39.96 23.2 

Equipment .98 .6 

Rental and Fees 37.09 21.5 

Evaluation 9.01 5.2« 

SUBTOTAL 172.48 

University Overhead 14.36 

TOTAL $186.84 100. OX 



Table 4 

Home Visits 

P-rsonnel $92.80* 83.2% 

Travel 6.39 5.7 

Communication 1.15 1.1 

Supplies 1.60 1.4 

Equipment 0.00 0.0 

Rental and Fees .28 .2 

Evaluation 9.42 8.4 

SUBTOTAL $111.64 

University Overhead 9.30 

TOTAL $120.94 100.0% 



Table 5 
Materials 

Personnel $179.43* 70. U 

Travel 2.96 1.2 

Communication .33 .1 

Supplies 39.00 15.2 

Equipment 0.00 0.0 

Rental and Fees 25.16 9.8 

Evaluation 9.09 3.6 

SUBTOTAL $255.97 

University Overhead 21 .33 

TOTAL 277.30 100.0% 



a"^ In thousands of dollars 
SOURCE: Table 1 
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Potential "Benefits" and Market Characteristics 

Adult education efforts such as RFD can make vast socio- 
economic contributions to a variety of persons, particularly dis- 
advantaged Americans with employment. Income, and cultural problems. 
Typically, approximately 1 out of 8 Americans are officially (and 
conservatively) defined as members of the poverty population, and 
a like (or greater) population of Americans have 8 or fewer years 
of formal school. No more than one-third are 65 years or over and, 
as elsewhere, failure to meet adult education needs contributes to 
the hard-core of unemployed, underemployed, and poor citizens. The 
size of this adult market for RFD type programs varies geographically 
and by the definition used, yet It Is clear that, out of a popu- 
lation of some 82,000 family units (the approximate size of RFD's 
market) with a sizable number concentrated In rural areas (some 
24,000 families) and where Income and employment problems are pro- 
portionally high, there Is a clear need for project RFD. 

Continuing education of this sort may be of particular Importance 
since It offers a second chance for adults who once may have been 
adolescent dropouts and only later developed the motivation and 
maturity to acquire the training required In a modern society and 
economy. Considering coping problems as ranging across such diverse 
subjects as acquiring knowledge about consumer Installment credit; 
providing home repair services; learning the basics of adequate 
nutritional and health needs; or managing personal finances and 
finding out about alternative job or occupational opportunities. 
It Is rather easy to envision a family unit benefiting by several 
hundred dollars a year over their remaining lifetime. Further 
'spillover" benefits may also accrue to children, dependents, or 
other adults associated with an affected family unit. In which 
case substantial multiplier Impacts may spin out of programs 
such as those of RFD. Finally, society Itself will. In all pro- 
bability, capture substantial benefits In a variety of ways Including 
a more Informed citizenry and electorate; better health and produc- 
tivity; and possibly lower welfare burdens, juvenile delinquency or 
crime, and fewer educational and societal "dropouts." 

Economic research efforts have, in spite of numerous benefit 
quantification problems. Identified the desirability of a variety of 
public expenditure programs. Presuming that the cost-effectiveness 
equivalent of $400 per year In material Improvements In coping 
behavior were forthcoming from an effort such as RFD over a 20-year 
lifetime, each 1 percent of all family units in the market for such 
a service would receive $4,600 In ascertainable benefits. 

One way in which intangible and difflcul t-to-quantify benefits 
or "effectiveness" can be assessed and imputed Is to vary certain 
data parameters about which uncertainty exists. Suppose that (a) 
benefits prevail In the $300 to $500 annual amounts as denoted 
In Table 6; (b) success ratios ranged from 1 out of 10 to 1 out of 30 
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farallles; (c) 3.000 families were exposed to an effort such as 
project RFD; (d) there were no social benefits nor any spillover 
or multiplier effects; and (e) the social discount rate Is 6 
percent over a 20-year lifetime (In reflection of the public 
sector's opportunity cost of capital). Cost-effectiveness relation- 
ships for annual outlays are shown In Table 6. 

Table 6 

Hypothetical Cost-Benefit Comparisons for RFD* 

Annual Value Proportion of Persons Exposad and Materially 

of Benefits Aided out of 3.000 Exposed Units 

^ N - 1/10 N ^ 1/20 N ^ 1/30 

Present Value $690,000 $345,000 $235,000 

Ratio B/C if C « $100,000 . . 6.9 3.5 2 4 

Ratio B/C If C « $200,000 . . 3.o 1.8 12 
$300 

Present Value $1,035,000 517,500 346.000 

Ratio B/C If C « $100,000 . 10.4 5.2 3 5 

Ratio B/C If C « $200,000 . 5.2 2.6 lis 
$400 

Present Value $1,380,000 690,000 460.000 

Ratio B/C If C = $100,000 . 13.8 6.9 4.6 

Ratio B/C If C « $200,000 . 6.9 3.5 2.3 
$500 

Present Value $1,725,000 862,500 575,000 

Ratio B/C If C « $100,000 . 17.3 8.6 sIs 

Ratio B/C if C = $200,000 . 8.7 4.3 2 9 



♦The annuity value of 11.47 applies at 6 percent for 20 years (see page 52 ). 

Under the stringent assumption that annual depreciable 
project costs equal $200,000, benefits are valued at $200 annually, 
and the success ratio Is a mere 3.3 percent of the exposed popu- 
lation, the hypothetical RFD payoff would be B/C « $235,000 « $1.17 

$200,000 

for each $1 In costs. At the other extreme of $100,000 In annual 
costs, $500 In annual benefits, and a 10 percent success ratio, B/C « 
$17.25 for each $1 In outlay. The "true" level of effectiveness no 
doubt lies between such extremes, however, it must also be remembered 
that the above data comparisons assume that all expenditures are 
directly output-oriented. This, of course, is much too restrictive a 
presumption for RFD since some rather substantial proportion of the 
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$708,000 In expenditures was related to demonstration and experimental 
goals. Then» too, the above comparisons fall to disaggregate 
effective costs and values emanatlno from various RFD media 
directed at differentiated markets (e.g., target groups vs. other 
exposed populations). 

Analysis of Impact 

Table 6 and the discussion suggest that the benefit/cost ratio 
for a project like RFD Is quite favorable if one can assume at 
least $200 worth of annual benefits. Unfortunately the evaluation 
data of the project do net support the assumption. On the other 
hand, there are likely many benefits or outcomes of the project 
that were never observed, but which were real and could easily 
add to $200 per year. Repairing something. Improved buying proce- 
dures, saving on 'nterest rates, saving a life; these and other 
things are benefits that reasonably might accrue tc project participants. 

An attempt was made to quantify the Impact of the project 
using a probability modeling technique. The rationale for this 
technique Is presented below. 

A Framework for Probability Modeling . 

Management scientists have developed and applied a vast assort- 
ment of analytical models to many areas of managerial control In the 
private sector In recent years. Some examples are Inventory 
management, brand preference analysis, credit rating terms, fore- 
casting and evaluating aggregate demand for a firm, financial planning 
and Investment control systems, and risk analysis of collective 
bargaining and capital budgeting problems. The methodology and 
models used by private enterprise must be restructured to various 
degrees to fit the public sector management context. There are 
three fundamental features which characterize such decision problems. 

1. Probabilities must be non-negative and also equal to one 
for all events which are certain to occur. 

2. Any events which do not occur jointly are the sum of all 
probabilities for Individual subevents. 

3. The value of outputs (often In the form of incommensurable 
products or output) must be quantified— a difficult but 
nonetheless not impossible task. Millions of dollars in 
resources are made available for public sector expenditures 
in order that some given task with an alleged value might 
be performed. The very commitment of economic resources 
tacitly provides imputed shadow values. 

There are rather significant differences between statistical 
probabilities and judgmental uncertainties. The former is best 
termed an objectivistic view of statistical decision making, 
whereas the latter is a subjectivistic interpretation of probability. 
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Many scholars with vast experience In management science and In 
other related disciplines concentrate only upon objective, statistical 
probability analysis—a comfortable, logical, and empirically "firm" 
view of the world. Unfortunately, the objectlvlstic view also crucial 
relationships as givens. Including the Interaction between objectlvlstic 
and subjectlvlstic data as well as the singular Influence of the latter 
type of judgmental uncertainties. Objective probabilities do 
Indeed represent the "best of all possible worlds" for the academic 
analyst, but as models or generalizations of reality they do not 
necessarily represent even "second best" solutions. Experiments 
cannot always (or even most of the time) be repeated Independently 
over and over again under uniform conditions. As uncomfortable as It 
may be, the real world environment Is uncertain and dynamic, 
and one often Is forced to view objectlvlstic efforts as being more 
or less useless as predictive, explanatory, management decision models 
of the optimal Ity variety. 

Three of the evaluation team members and three of the project 
staff made several judgments of the Impact of the project using a 
Bayeslan methodology of the probability model. A complete description 
of the approach will be presented In a technical report under pre- 
paration. The results are presented In Tables 7, 8, 9, and 10. 
Table 7 contains the averages of the probability that a certain degree 
of Improved coping behavior was attained In the target and tota? 
population. Table 8 shows the average prooablllty that each proportion 
of persons In the target and total population was materially aided 
from RFD. Table 9 contains the average probability what Improved 
coping skill would be worth to the participant. Table 10 shows the 
judged and desired weight given to six goals of the project, and the 
judged degree of success with the overall goal. It will be 
recognized that the overall goal was the first objective of the 
project. The six goals were rewordlngs based on the other nine 
objectives of the project. Figure 2 presents a comparison of the 
difference between the evaluation team and the project leaders In 
their judgment of the degree of success of attainment of the overall 
goal. The following material Is based on these tables and the budget 
data . 

Aggregate Cost-Effectivcness of RFD. 

In what follows, we shall first summarize aggregate cost-effectiveness 
and the comment upon the three major media approaches. 

Let us assume that: 

1. Costs and returns are a linear and direct function of 
persons subjected to RFD efforts. 
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2. All costs of types I and 11 are fixed, having a straight- 
line depreciable life of five years, with a remaining salvage 
value of 10 percent of total fixed charges O0% x $570,000). 
The $570,000 figure Includes type I and II costs plus all 
overhead costs. 

3. FC » fixed charges less salvage value $57,000) (Cf » FC/Q 
Is averaae fixed charge allocation where Q « the number of 
families;. 

4. VC » variable charges (Cv - VC/Q Is average variable charge 
allocation). 

5. Bv = effective present value of returns or Q • V, where ? 
represents the average annual value of RFO to a participa- 
tory family. 

6. IF it the Interest factor. All monetary values are always 
In terms of present worth, discounted at the social rate 
of discount (assumed here to be 6 percent). 

Under these circumstances, fixed charges assignable yearly, exclud- 
ing university overhead, approximate $102,000, whereas variable cost 
charges total $138,000. Assuming that the number of families benefit- 
ing from RFD equals the number In the taraet group (50 families), 
and that an equivalent annual benefit of $400 per year per family for 
20 years Is applicable, the data from Table 6 reveal that: 

Bv _ $230.000 . 
IT " $102,000 + $138,000 " '^^ 



It Is much more likely, however, that some number In excess of 
1.6 percent of 3,000 exposed families benefited fully from RFD. As 
Figure 2 reveals, for each such 10 family units above the break-even 
level (Bv/C = 52 X 4,600,/$240,000 * 1 .0) of 52 family beneficiaries 
net benefits above annual costs rise by $46,000, or the ratio Bv/C 
Increases by approximately .2 for each 10 unit Increase In family 
beneficiaries (e.g., at 100 families; Bv/C » 1.9, at 150 families, 
Bv/C = 2.9; and at 200, Bv/C = 3.9). 



The present value of benefits, Bv, for a lump sum of $A' In 
the future Is A" x the reciprocal of the compound Interest factor 
(1 + 1)". The present value of a uniform annual series of $V 
per year Is Bv = $V x IF, where 

IF " InV] )^*^ " "'^•^'^ ^or 20 years. 
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Thus far, little has been said about the measurable effective- 
ness of RFD— and for good reason. First, this effort represents 
the classic case of Intangible and Incommensurable benefits; I.e., the 
assignment of economic value to achieving greater coping behavior Is at 
best a very hazardous undertaking. The hypothetical "Implied" valuation 
options discussed In the previous section suggest that efforts such 
as RFD probably are economic In nature, and perhaps substantially 
so. To sharpen our understanding of the cost-effectiveness of RFD, 
some consideration can be given to certain "subjectlvlstic" probability 
data gathered In an attempt to gauge project success. 

Table 7 Indicates, for the target population of 46 disadvantaged 
families and the other exposed population, the "most probable" 
levels of Improvement In coping behavior might be In the order of 20-25 
percent for the target group and 10-15 percent for the other exposed 
population. Unfortunately, subjectively determined probabilities such 
as these are not really confirmed by the evaluation data. 

Table 7 

RFD's Impact on Improved Coping Behavior 



Degree of Coping 

Behavior Improve- Probability That Stated Level of Improvement 

ment Was Achieved 

At Least Target Others 



1/2% .03 (.07)* .28 (.18)* 

3% .15 .13) .10 (.12) 

10% .21 (.20) .19 (.27 

20% .19 (.12) .15 (.20 

30% .12 .13) .08 (.07) 

40% .08 (.11) .06 (.05) 

50% .06 (.04) .04 (.03) 

70% .05 (.04) .04 (.03 

80% .04 (.05) .04 (.05 

80%+ .07 (.03) .05 (.00) 



*Data estimate of the evaluation team only, whereas data not In ( ) 
represent the weighted average of key project leaders and the eval 
uation team members. 



Table 8 depicts the best "quesstimates" of project leaders 
and the evaluation team concerning the proportion of persons materially 
aided. While again subject to numerous criticisms concerning data 
reliability, it is clear that those close to the project subjectively 
judge that something between 15-25 percent of the target group and 5-15 
percent of the other exposed population received such benefits in some 
measure. 
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Table 8 

Proportion of Exposed Population Benefiting From RFD 

Proportion of Persons Probability that Stated Percent of Exposed 

Exposed to RFD Population Were Materially Aided 

"Materially Aided" Target Others 

5% .17 (.30)* .36 (.62)* 

15% .10 (.20 .14 (.16 

25% .13 .18) .14 .14 

40% .20 (.23) .17 (.04 

60% .20 .03 .10 .04 

80% .15 (.03) .08 (.00 

80%+ .05 (.03) .01 (.00] 



*Data estimates of the evaluation team only, whereas data not In ( ) 
represent the weighted average of key project leaders and the evalu- 
ation team. 

On the basis of such Information and other subjective Impressions 
as well as objective Information, our rough conclusions are: 

1. The marginal Impact of the home visit program was such as 
to double the effectiveness of RFD (In terms of both 
Improved coping behavior and proportion of population 
materially aided). 

2. Of some 3,000 persons In the "other population" exposed to 

RFD, something upwards to the equivalent of 50 families (ranging 
to as many as 150 or more) benefited fully from RFD. 

Table 9 represents an attempt to quantify. In annual dollar returns, 
the effective value of Improved coping behavior. On a weighted 
average basis, per unit target group benefits appear to range from 
$350-$450 annually, whereas the subjective value placed upon the 
per unit value of Improved coping behavior for the other exposed popu- 
lation approximates $300-$380. 

Finally, Table 10 reveals the degree to which project team 
members and the evaluation team weighted the goals and overall per- 
formance of RFD. Goal I ("create a viable TV-based multi-media 
reusable program") and Goal II (Involve a large number of under- 
educated adults ...) appear to have received most emphasis. In 
general terms, a significant disparity In the judgment of overall goal 
achievement of "demonstrating the effectiveness of the Integrated 
program" exists, where the evaluation team tends to rate level of 
achievement at about 40 percent compared to something like a 70 percent 
rating on the part of project staff. 
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Table 9 

Value Alternatives for Improving Coping Behavior 
Appraised Subjectlvlstic $ Probability of Stated $ Levels 



Value of Improved Coping Skill Target Other 



$ 0-100 .17* .12* 

$101 - 200 .20 .25 

$201 - 300 .12 .18 

$301 - 500 .19 .19 

$501 - 700 .10 .13 

$701 - 900 .11 .11 

$900+ .11 .02 



*Data estimates of the evaluation team and the key project leaders. 
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(a) Goal Importance 



Table 10 
Overall Project Performance 



Evaluation Team Project Leaders 

Desired 

Rank Weight 



Six Alternative 

Goals Rank Weight Weight 



Goal 


I 


1 


.37 


(.18 


Goal 


II 


2 


.20 


.13 


Goal 


III 


4 


.12 


(.08 


Goal 


IV 


6 


.08 


(.10 


Goal 


V 


3 


.13 


.13 


Goal 


VI 


5 


.10 


(.17 



1 

2 
5 
6 
3 
4 



.30 
.28 
.08 
.07 
.17 
.10 



Goal 



Goal 



I - Create a viable television based multi-media program 
usable In similar situations In other parts of the country. 

II - Involve large numbers of adults not now able or willing 
to participate In ABE programs. 

Goal III - Assist In the development of skills that can lead 
to new careers for home study aides and other staff 
members . 

Goal IV - Demonstrate Involvement of disadvantaged Individuals 

In the development and Implementation of such a program. 

Goal V - Develop participant skills In the basic fields of 
communication and computation while Improving the 
capability of the target audience to exercise citizen- 
ship responsibilities. 

Goal VI - Develop participant skills from present proficiency 

toward eighth and twelfth grade equivalency achievement 
levels. 

(b) Overall Achievement 



Degree of Success in Achieving Goal 
of "Demonstrating effectiveness of 
Integrated television, home study, 
home contact, and visit program for 
rural ABE students. 

10% 

30 

50 

70 

90 



Probability that Stated 
Level Was Achieved 

.11 
.12 
.24 
.31 
.22 
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Degree of Overall Achievement 
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Some Conwents on Individual Media Effectiveness 

No evaluation of the home visit program can Ignore the fact that 
It Involved Incremental costs of $112,000 (or more than $2,400 
per 46 final participants), some $98,000— or $2,100 per unit— of which 
represents variable expenditures. There Is no way In which even break- 
even cost effectiveness can be obtained unless variable expenditures 
per unit can be covered. For the home visit program, potential 
Bv « $4,600, Cv « $2,100, FC » $13,800, and Q « 46. 

For the home visit program to be minimally effective at the margin. 
It would require that the Incremental gain In probable benefits (P) 
Increase to .46. That Is, as a result of the home visit program alone . 
It Is necessary that the RFD project success ratio rise to almost 
1 out of every 2 exposed persons. 

P ' Bv > Cv 
P • 4,600 ^ $2,100 
P = .46 

It does not appear reasonable to presume gains such as Increased 
success ratios up to almost 1 out of 2 families were forthcoming 
at the margin from home visits; hence. It Is difficult Indeed to 
justify the home visit portion of Project RFD. However, since one 
cannot separate the "joint" product resultant from some combination 
of TV, Materials, and Home Visits, about all that can be said Is 
that the burden of proof for Home Visits rests with that program and 
Its rather high unit costs relative to a nominal quantity base. 

It should be kept In mind the Home Visit component was judged to 
have had quite an effect on project Impact with those It reached. 
Also the costs of this component might be reduced considerably by 
more efficient use of home visitors or by such things as volunteer home 
visitor-. 

Again considered separately, the cost-effectiveness of TV as 
a media may represent a more economic operation. Assuming some 20,000 
families were exposed to and benefited from no less than one program, 
it would require only $1 per year per family in benefits spread over 
a 20-year benefit lifetime to achieve a benefit/cost ratio equal to 
1.3. 

Bv $n.47 _ , 
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A1ternat1v6ly» If only 1 out of 10 exposed families acquired annual 
benefits equal to $20 per year and such families accure the 
average costs of 10 exposed family units, each $1 In costs would 
generate $2.67 In benefits. 

Bv ^ $229.00 . , 
C MOQ $ 86.00 " 2-^^ 

A tempering aspect to this favorable ratio Is that the assumption 
of a five year life for the materials Is least tenable for television. 

Similar conclusions apply to the material media, which Include 
action line as well as a large variety of written materials. Assuming 
that simply 3,000 pieces of material were distributed at a total 
cost of $256,000 or an average cost of $85, break-even cost-effectiveness 
would require benefits of approximately $7.40 per year for each 
material recipient, or some $15.00 annually If only one-half of 
all recipients actually benefited (or If a minimum Bv/C « 2 was 
stipulated and all recipients benefited. 

In summary, RFD appears to have been a reasonably cost-effective 
effort— In no small measure because (a) demand for such services Is 
substantial and (b) a relatively large number of persons were exposed 
to RFD (excluding the Home Visit program). These conclusions depend, 
however, upon the quantitative magnitudes used, and while much about 
the data Is admittedly difficult to pinpoint with accuracy and may even 
be 111-deflned, RFD does appear to have been a worthy research and ' 
demonstration effort. This Is not to say, however, that the greatest 
possible efflclences were achieved. Much about the Home Visit program 
was excessively costly relative to the potential benefits that could 
have been generated; the reusable output from TV as a media may be 
severely limited and If so, costs would have to be depreciated over 
less than 5 years; and the topical and qualitative features of much of 
the written materials could be Improved upon. 
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Recomnendatlons 

Our study of this project has suggested several recommendations of 
varied specificity. Most of the recommendations are offered as points 
worthy of consideration by people working In this area. 

1. The staff of the Project RFO should be encouraged and supported 
in continuing their work In this area. They have now developed 
an expertise that should not be lost from lack of use. 

2. Television and home study materials seem to have favorable 
cost/effectiveness possibilities, but It Is more difficult 
to justify home visitors on a cost/effectiveness basis. 

3. We would recommend that an educational type project should 

be Identified with and administered In a unit that has expertise 
In the content and audience rather than a materials production 
unit. 

4. Obviously, all components of a project should be ready when 
needed. The experience of RFD points to the need for planning 
sufficient lead time to Insure that all components are ready. 

5. Educational programs should be planned with the target 
audience not for them. 

6. Evaluation activities should be closely tied to the on-going 
administration of the project so that they are kept relevant. 
Furthermore, the evaluation should be planned so that It Is 
largely done In time for use In the dissemination activities. 

7. Testing and other kinds of data gathering with adults are 
problems. Unobtrusive measures should be used If possible. 
Where direct data gathering Is to be done, the project should 
be straightforward and honest In Its approach. It should 
not do things It said It wouldn't do. 

8. Educational activities are products to be marketed, and 
sophisticated approaches to marketing them seem to be justified. 

9. The Integration of various educational media Is easier said 
than done. Experimentation is still needed In this area, 
especially in difficult to control situations like home study. 
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10. When using a home visitor approach It would seem that two 
things might be considered to optimize effects. 

(a) Select for the treatment those who are quite aware 

of what Is Involved, and who have Indicated an Interest 
In being Involved based on their awareness, or 

(b) Have a warm-up period In which the home visitor Is able 
to establish the needed rapport before the rest of 

the treatment Is started. 

11. There Is evidence to recommend that techniques like enrollment 
and stated commitment are conducive to participation and per- 
sistence by adults In educational programs. 
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List of Recomnended Project Materials for In-Depth Information. 
Limited copies are available from the project. Items 1» 2, 3» and 
6 will likely be In ERIC. 

1. RFD - The First Year - Provides descriptions of the planning 
ani* the conceptualization of the project. 

2. RFD - Rural Family Development - Second Year Report, June, 1971. 
Fgbod description of the operation of the project. Several 

of the reports of the Internal evaluators are Included. 

3. The RFD System - This report provides a good overview of 
each component. Cost estimates are Included. 

4. Newsletters - A complete set of the newsletters published monthly 
will provide a good overview of the project. 

5. The Almanac - A copy of the almanac Is useful reading In that 
Tt~g1ves an Idea of the content emphases of the project. 

6. A third year report will be written. It will Include 
additional reports of the Internal evaluators. 
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Information and Reporting 

Throughout the three years of the HFD project a commitment 
was steadfastly maintained to publish information about the 
project. Publications were especially prepared for those 
who have professional interests in the project. Through these 
publications progress and development was reported on a con- 
tinuing basis. 

During the term of the project, 36 issues of the monthly RFD 
Newsletter were published. Approximately 125,000 copies were 
mailed to a list averaging 3,500 individuals. The Newsletter 
was the primary vehicle for continuous information dissemina- 
tion. It, in affect, became the chronicle of RFD. A number 
of significant articles of general interest to educators of 
adults appeared in the Newsletter. Several have been selected 
for reproduction in this report and are to be found on pages 
1 through 17. 

At the conclusion of the first and second years of operation, 
annual reports summarizing the years activities were published. 
This is the third and last of that series. 

Another major summary publication was entitled The RFD System 
and was designed as a basic manual to assist in the replication 
of the several components of the project. In addition to 
general how-to-do-it information. The RFD System contained 
recommendations for implementation based upon evaluation 
data. 
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A number of highly specialized publications and interim 
reports were prepared by the project, each dealing with a 
particular segment. In addition, samples of promotional and 
participant learning materials and evaluation instruments 
were provided upon request. 

RFD, during its first year, built an exhibit display. (See 
photograph, page 48. it was used initially at the county 
fairs in the four county field test area during the summer 
of 1970 as a means of informing the public of the coming 
availability of the program and encouraging participation 
in its mass media components. It was later adapted and used 
as an exhibit at annual conventions of the following profes- 
sional organizations: 

October 25-30, 1970 Adult Education Association of the 

Atlanta, Georgia U.S.A. and National Association for 

Public Continuing Adult Education 

March 28-31, 1971 North Central Association of Colleges 

Chicago, Illinois and Secondary Schools 

^^l^^J^'^^* l-^^^ Wisconsin Adult Education Association 

Lake Del ton, Wisconsin 

May 12-14, 1971 Adult Education Association of the 

Chicago, Illinois U.S.A. Commission on Adult Basic 

Education, Conference of 100+ 

Jiine 13-16, 1971 Central Educational Television Network 

Milwaukee, Wisconsin 

During the months of May and June, 19 72, RFD hela a series of 
ten regional workshops; one in each of the Department of Health, 
Education and Welfare regions. Approximately 8,000 individuals 
in the field of adult education, higher education, university 
extention, educational media, health and social services and 
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Each workshop included an evening session the first day followed 
by a full day. Although the agenda was kept flexible to better 
meet the needs of those participating, it did tend to follow 
a general pattern. The evening session was devoted to an 
introduction to the design of the project and included the 
showing of a specially prepared 16mm film followed by discussion. 
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The morning of the second day was devoted primarily to a 
discussion of the rationale for project design and specifics 
of implementation based somewhat on written statements of 
expectations solicited from the participants the previous 
evening. Most of the discussion during the afternoon of the 
second day was concerned with findings of the evaluational 
aspects of the project. 

The Kropp Vemer scale for evaluation of the worth of confer- 
ences as perceived by participants was administered at the 
conclusion of each workshop, (see page 288.) The scale con- 
sists of a series of 20 weighted items in rank order. Parti- 
cipants were asked to rate the workshop by selecting those 
items which most closely represented their feelings. The 
highest possible rating is 1.13; the lowest 10.89. A total of 
2 36 (59.3%) individuals out of 398 attending the workshops 
returned questionnaires. The mean score was 4.13 and the 
standard deviation was 1.49. 

The mean of 4.13 lies approximately slightly below "It solved 
some problems for me." Means for each regional workshop are 
given below. 



Mean Scores for Workshop evaluations 



Region 



Me an 



I 

II 

III 

IV 

V 

VI 

VII 



4.03 
3.73 
3.88 
4.27 
4.40 
3.91 
4.47 
4. 54 
4.69 
4.24 



VIII 



IX 
X 
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RFD 



A NATIONAL AOULT BASIC eOUCATION DSMONSTHATION ^MXIBCT 



RURAL FAMILY 

DE VE LOPMENT FARTICIPANTOPINIONNAIRE 

Now th« this conf trcnct his drawn to • ctow, wt art Mrtdn thM you hMt tomo fMlingi at to tht vaiut or 
worth of thff progrtm to you. It will bt vary hatpful If you will ihara thaw ftallngi with tha plannart ao at 
to anabia tham to plan f uturt oonfaranoaa that will Hlttar maat tht naads of partlelpantt. 

Wa will appraciata It if you will lalaet from all tha sutamantt liatad balow only thoaa that daaeriba moit 
aocurataty your faalingi of tha ovarall valua and worthwhUanaia of tha total program. Plaaaa raad all tha 
ttatamants fint. Than, placa a chack in tha boxaa to tha laft of all tha itatamanti which aeeurataly axpraia 
your faalingi. 



□ It was ona of tha most rawardlng axpariancas 1 hava avar had. 

□ Exactly what I wantad. 

□ I hopa wa can hava anothar ona In tha naar futura. 

□ it providad tha kind of axparlanea that 1 can apply to my own situatton. 

□ It hatpad me panonaily. 

□ It solvad soma problams for ma. 

□ I think it servad its purpoaa. 

□ It has soma marits. 

□ it was fair. 

G it was naithar vary good nor vary poor. 
Q I was mildly disappointad. 

□ It was not exactly what I naadad. 
n it was too general. 

□ I am not taking any new Waas away. 

□ It didn't hold my interest. 
Q It was much too superficiai. 

□ i leave dissatisfied. 

G It was very poorly planned. 

G I didn't learn a thing. 

G It was a complete waste of time. 
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